ruby_parser version 3.21.0 has been released! * home: <https://github.com/seattlerb/ruby_parser> * bugs: <https://github.com/seattlerb/ruby_parser/issues> * rdoc: <http://docs.seattlerb.org/ruby_parser> ruby_parser (RP) is a ruby parser written in pure ruby (utilizing racc--which does by default use a C extension). It outputs s-expressions which can be manipulated and converted back to ruby via the ruby2ruby gem. As an example: def conditional1 arg1 return 1 if arg1 == 0 return 0 end becomes: s(:defn, :conditional1, s(:args, :arg1), s(:if, s(:call, s(:lvar, :arg1), :==, s(:lit, 0)), s(:return, s(:lit, 1)), nil), s(:return, s(:lit, 0))) Tested against 801,039 files from the latest of all rubygems (as of 2013-05): * 1.8 parser is at 99.9739% accuracy, 3.651 sigma * 1.9 parser is at 99.9940% accuracy, 4.013 sigma * 2.0 parser is at 99.9939% accuracy, 4.008 sigma * 2.6 parser is at 99.9972% accuracy, 4.191 sigma * 3.0 parser has a 100% parse rate. * Tested against 2,672,412 unique ruby files across 167k gems. * As do all the others now, basically. Changes: ### 3.21.0 / 2024-01-15 * 18 minor enhancements: * (internal) Added simple RubyLexer#comment. * (internal) Removed RubyLexer#comments and #ignore_body_comments. * (internal) Removed RubyParser#comments. * (internal) Renamed files from lib/ruby##_parser.* to lib/ruby_parser##.* * (internal) Renamed lib/ruby3_parser.yy to lib/ruby_parser3.yy * (internal) Renamed lib/ruby_parser.yy to lib/ruby_parser2.yy * Added tentative 3.2 support. (torrocus) * Made `rake compare` a multitask (28s -> 10s!!). * Made `rake compare` depend on `generate` (from clean: 28s -> 18s). * No longer package versioned .y files. * Overhaul of parser/lexer comment processing. * Parser productions for k_class/k_module/k_def carry their comment with them. * Restructured build tasks to utilize Hoe's .yy support! 8.5s -> 1.2s!!! * RubyParser new_(class|module|defn|defs) handle comment processing via sexp. * RubyParser new_(class|module|defn|defs) handle normalizing production sexps. * RubyParser#next_token clears out lexer's comment when applicable. * Simplified parser productions for defn_head, defs_head. No more normalizing. * Updated `rake compare` steps for lrama in ruby 3.3+. * 6 bug fixes: * Cleaned out cruft from `rake compare` code. * Fixed compare/normalize.rb for lrama differences. * Made `parser` task depend on `isolate` task to pick up racc generator. * Made racc a runtime dependency (was dev only) now that ruby 3.3 doesn't ship with the racc runtime. (wildmaples) * Updated README.rdoc updating instructions to match current filenames. * Updated compare versions and added 3.3.