Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update the ocaml-tree-sitter runtime library #510

Merged
merged 17 commits into from
Sep 18, 2024
Merged

Update the ocaml-tree-sitter runtime library #510

merged 17 commits into from
Sep 18, 2024

Conversation

mjambon
Copy link
Member

@mjambon mjambon commented Sep 18, 2024

This required reverting changes for the following languages because the Semgrep integration wasn't in sync:

There was also a tricky bug occurring only in Semgrep which was due to tree-sitter-vue which was solved by patching tree-sitter-vue (it was declaring tree_sitter_html_* functions that were apparently picked by the linker instead of the real tree-sitter-html functions). Here's the modified version of tree-sitter-vue we're now using: ikatyang/tree-sitter-vue#30. I added a safeguard so that future updates of the tree-sitter-vue submodule fail gracefully if some tree_sitter_html_* functions make a comeback.

The accompanying pull requests are:

On my machine, regenerating the Hack grammar takes 16.4 GB of RAM. C# is the second biggest memory consumer with 14.2 GB.

Checklist

  • Any new parsing code was already published, integrated, and merged into Semgrep. DO NOT MERGE THIS PR BEFORE THE SEMGREP INTEGRATION WORK WAS COMPLETED.
  • Change has no security implications (otherwise, ping the security team)

@mjambon mjambon requested a review from a team as a code owner September 18, 2024 02:59
@mjambon mjambon requested review from emjin and aryx September 18, 2024 02:59
@mjambon mjambon requested review from nmote and removed request for emjin September 18, 2024 03:41
@aryx
Copy link
Collaborator

aryx commented Sep 18, 2024

@yosefAlsuhaibani @brandonspark once this is merged you will need to restore your improvements to semgrep-go and other

@mjambon mjambon merged commit e4bd859 into main Sep 18, 2024
2 of 3 checks passed
@mjambon mjambon deleted the martin/extras branch September 18, 2024 17:10
semgrep-ci bot pushed a commit to semgrep/semgrep that referenced this pull request Sep 18, 2024
…oprietary#2260)

This changes the type of tree-sitter parsing results. This required
regenerating all the grammars. Passing CI tests with this pull requests
validates the other two pull requests:
* semgrep/ocaml-tree-sitter-core#48
* semgrep/ocaml-tree-sitter-semgrep#510

test plan: `make test`

synced from Pro bc3fa2e1e2838941e3860d422569ca6a35826b15
semgrep-ci bot pushed a commit to semgrep/semgrep that referenced this pull request Sep 19, 2024
…oprietary#2260)

This changes the type of tree-sitter parsing results. This required
regenerating all the grammars. Passing CI tests with this pull requests
validates the other two pull requests:
* semgrep/ocaml-tree-sitter-core#48
* semgrep/ocaml-tree-sitter-semgrep#510

test plan: `make test`

synced from Pro bc3fa2e1e2838941e3860d422569ca6a35826b15
nmote pushed a commit to semgrep/semgrep that referenced this pull request Sep 19, 2024
…oprietary#2260)

This changes the type of tree-sitter parsing results. This required
regenerating all the grammars. Passing CI tests with this pull requests
validates the other two pull requests:
* semgrep/ocaml-tree-sitter-core#48
* semgrep/ocaml-tree-sitter-semgrep#510

test plan: `make test`

synced from Pro bc3fa2e1e2838941e3860d422569ca6a35826b15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging this pull request may close these issues.

2 participants