Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

v1.2.0 release notes do not mention that RubyThreadLocalVar class was removed #986

Closed
laser opened this issue Jan 23, 2023 · 8 comments
Closed

Comments

@laser
Copy link

laser commented Jan 23, 2023

Problem

The v1.1.0 release defined a class called RubyThreadLocalVar (link). That class does not exist as of v1.2.0 (link) - the file in which it was defined was removed in commit 30465396 - but the removal was not mentioned in the v1.2.0 release notes. I'm not sure if this was an oversight or a bug.

Proposed Solution

Either the changelog should be updated to reflect the breaking change, or the RubyThreadLocalVar should be restored.

@eregon
Copy link
Collaborator

eregon commented Jan 23, 2023

Any class starting with a Ruby, JRuby, Java, TruffleRuby prefix is as fairly obvious an implementation detail.
Relying on that is unsupported.
So it an implementation detail and therefore does not have any compatibility guarantee and is not mentioned in the CHANGELOG.

Were you using it? Why instead of using the supported ThreadLocalVar?

The list of public classes is in the documentation: https://ruby-concurrency.github.io/concurrent-ruby

@laser
Copy link
Author

laser commented Jan 23, 2023

@eregon - Nice, thanks for addressing this issue. I don't think that our team (initially) recognized the Ruby prefix as an indication of an implementation detail. Since ThreadLocalVar is the preferred interface to this functionality, we'll use that.

Thanks again for your quick reply. I appreciate it!

@laser laser closed this as completed Jan 23, 2023
@joshcooper
Copy link

Hi just wanted to add that Puppet was relying on Concurrent::RubyThreadLocalVar for both MRI and JRuby, because JRubyThreadLocalVar leaked a reference to the JRuby instance after it was discarded. I don't know if an issue was filed... but here's the commit where that change was made: puppetlabs/puppet@9182bc3

@eregon
Copy link
Collaborator

eregon commented Jan 23, 2023

I can't find an issue about that, would have been nice to file one before relying on a library's internals.
I think you can easily preserve your behavior in Puppet either:

  • by fixing the concurrent-ruby version to 1.2+ and using Concurrent::ThreadLocalVar
  • or if you need to support both versions of concurrent-ruby then something like
    defined?(Concurrent::RubyThreadLocalVar) ? Concurrent::RubyThreadLocalVar : Concurrent::ThreadLocalVar.

@ioquatix
Copy link
Contributor

ioquatix commented Jan 24, 2023

I agree with @eregon, however I think it's even more clear cut than "any class starting with a Ruby implementation name is an implementation detail".

Specifically:

https://github.com/ruby-concurrency/concurrent-ruby/blob/v1.1.10/lib/concurrent-ruby/concurrent/atomic/ruby_thread_local_var.rb#L6-L8

Mentions that the class is private and an implementation detail. If you search the documentation, AFAICT, it doesn't even show up: https://www.rubydoc.info/gems/concurrent-ruby/1.1.10 - this applies to all code which is an implementation detail.

I think it's fair to say, the authors and maintainers of the library have done their best to clearly mark private implementation details. However, I'm left wondering how code has come to depend on RubyThreadLocalVar. Was it possible in the past this was not marked as an implementation detail?

We should consider using private_constant more judiciously perhaps.

@laser do you think we should add the removal and changes to implementation details? I'm not against it, but it might detract from the actual list of public interface changes.

Regarding Puppet using an internal implementation detail, well, I can understand the pain, but we are stuck between a rock and a hard place. That interface was never expected to be used publicly. As maintainers, if we don't know about it, we can't do anything about it. If no issue was filed about the leak, or promoting that interface to a public one, I don't see how this situation could have been avoided (I believe private_constant is a somewhat recent innovation to Ruby).

I see three potential solutions going forward - the one provided by @eregon makes the most sense to me and is the most future looking.

The other two options are:

  • Pin your dependency on concurrent-ruby 1.1, or
  • Consider re-introducing Concurrent::RubyThreadLocalVar as an alias for Concurrent::ThreadLocalVar but mark it as deprecated (and do a v1.2.1 release).

@joshcooper
Copy link

joshcooper commented Jan 24, 2023

I agree this is a Puppet bug and we're taking steps to remedy. I don't remember the exact specifics of what the underlying issue was, but it doesn't help us now.

That interface was never expected to be used publicly

Yes that's true, but due to Hyrum's law combined with the fact that it's hard to hide implementation details in Ruby, I would have rather seen this change released as version 2.0. I tend to take a conservative approach because I've been bitten by this kind of thing so many times.

re-introducing Concurrent::RubyThreadLocalVar as an alias for Concurrent::ThreadLocalVar

That would be awesome and greatly appreciated.

@eregon
Copy link
Collaborator

eregon commented Jan 25, 2023

FWIW this API was clearly marked internal since 2015 or earlier:

# @!visibility private
# @!macro internal_implementation_note
class RubyThreadLocalVar < AbstractThreadLocalVar

So I don't believe there could be any confusion there whether this was internal or not.

@laser
Copy link
Author

laser commented Jan 25, 2023

Hi folks,

My two cents, since I'm subscribed to the thread:

I think that it was a mistake for our developer to use RubyThreadLocalVar. I agree that the documentation calls out that the class was private. We didn't look at that documentation, clearly. That's on us.

I also agree that distinction between public and private in Ruby is hard to enforce. I'm not sure how to solve that problem.

Based on what I've learned in this thread, I no longer think that the v1.2.0 release notes should have mentioned RubyThreadLocalVar, as it was not part of the library's public interface.

freebsd-git pushed a commit to freebsd/freebsd-ports that referenced this issue Feb 5, 2023
- Bump PORTREVISION for package change

Use ThreadLocalVar instead of RubyThreadLocalVar which was removed in 1.2.0.
RubyThreadLocalVar is a private class and an implementation detail.

Reference:	ruby-concurrency/concurrent-ruby#988
		ruby-concurrency/concurrent-ruby#986
		puppetlabs/puppet@9182bc3
freebsd-git pushed a commit to freebsd/freebsd-ports that referenced this issue Feb 5, 2023
- Bump PORTREVISION for package change

Use ThreadLocalVar instead of RubyThreadLocalVar which was removed in 1.2.0.
RubyThreadLocalVar is a private class and an implementation detail.

Reference:	ruby-concurrency/concurrent-ruby#988
		ruby-concurrency/concurrent-ruby#986
		puppetlabs/puppet@9182bc3
oneiros added a commit to betadots/hdm that referenced this issue Mar 21, 2023
Puppet used to rely on an internal API that was removed.
See the follwing issue for details:

ruby-concurrency/concurrent-ruby#986
tuxmea pushed a commit to betadots/hdm that referenced this issue Mar 23, 2023
* update rails gems

* Upgrade puppet to fix regression.

Puppet used to rely on an internal API that was removed.
See the follwing issue for details:

ruby-concurrency/concurrent-ruby#986

---------

Co-authored-by: David Roetzel <david@roetzel.de>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants