bug#61302: 29.0.60; rust-ts-mode does not show function-invocation on field-properties

[Dmitry Gutov]

On 10/02/2023 05:44, Randy Taylor wrote:
> On Thursday, February 9th, 2023 at 16:19, Dmitry Gutov <dgutov@yandex.ru> wrote:
> > On 09/02/2023 05:38, Randy Taylor wrote:
> >
> > > > What if it looked like this:
> > > >
> > > >     let date = DateTime::<chrono::utc>::from_utc(date, chrono::utc);
> > > >
> > > > If we decide purely based on capitalization, then I guess the rule
> > > > should be present in both lists (with capitalized? regexp in one, and
> > > > !capitalized? regexp in another), and a few more rules should be
> > > > duplicated as well.
> > >
> > > In both cases, utc is still a type even if it's not capitalized.
> > > My patch addresses this.
> >
> > So the end of a scoping chain must also be either a type or a method
> > call? We might be able to use that, somehow.
>
> I believe so (with the exception of use declarations as you note).
> Not familiar enough with Rust to say for sure :).

So this is a discussion between two people who don't write Rust.

Hmmm. :-)

> > > > So 'usize' in the above is definitely a "type", not a "module"?
> > >
> > > I think so. You can see on usize's documentation page 
> > > (https://doc.rust-lang.org/std/primitive.usize.html)
> > > that it provides that function, amongst many others.
> >
> > I was thinking that it might also be referring to (apparently
> > deprecated) https://doc.rust-lang.org/std/usize/index.html.
>
> That module only provides the constants listed on that page.
> The usize type itself provides a bunch of constants and functions (same for the 
> rest of the primitives).
>
> I'm curious how other editors/IDEs highlight this stuff, but I don't have any 
> on hand ATM.

Here's some overview.

I mentioned previously 
https://github.com/tree-sitter/tree-sitter-rust/blob/master/queries/highlights.scm, 
which apparently corresponds to how Github highlights Rust syntax. E.g. 
here: 
https://github.com/tree-sitter/tree-sitter-rust/blob/master/examples/ast.rs

The capitalized identifiers are highlighted as "types", apparently, and 
the lowercase segments are not highlighted at all. For some reason the 
types are also not highlighted in variable and parameter declarations. 
That seems like a problem, FWIW.

If I press "edit in dev", navigating to 
https://github.dev/tree-sitter/tree-sitter-rust/blob/master/examples/ast.rs, 
that seems to open some webby version of VS Code, except with a 
different color theme.

Some observations:

- A lot more highlights.
- The "modules" and the "Types" have the same color.
- The identifiers at the end of a scope chain are not highlighted if 
they are a) lowercase and, b) not from a known set, apparently.
- So "use std::usize;" is highlighted and "use std::uuusizeee;" is not.
- "use std::foo::usize;" is highlighted.

This also matches with VS Code's behavior installed locally. Neither the 
"cloud" VS Code nor the local one use tree-sitter, IIUC.

IntelliJ Rust doesn't highlight "modules" or types at all, AFAICT: 
https://intellij-rust.github.io/assets/intro_screen_editor.png
And those guys usually write their own parsers, so the highlights are 
most likely parse tree based, just not with tree-sitter.

> > Sorry, I'm not really familiar with Rust. E.g. in Ruby every class can
> > also serve as a "module" in the scoping sense. As a result we highlight
> > both classes and modules with font-lock-type-face. This could also be an
> > option here, if everything else fails.
> >
> > But we could also highlight based on a "role" (constant if it's used as
> > a scope, and type if it's used as a type).
> >
> > Although one could say that 'Path' in
> >
> >    Some(Path::new("./foo"))
> >
> > is being used as a type as well, and 'Some' too. So it might not be the
> > best fit.
> >
> > Speaking of 'usize' again, what if some lib or the app defines an
> > 'usize' module for its custom functions acting on it? E.g.
> > 'my::app::usize'. A simple regexp matcher will probably highlight it as
> > a type as well.
>
> I don't think we should worry about those cases IMO.

Okay.

> > Some problems from my testing:
> >
> > 1. If I keep treesit-font-lock-level at its default value (3), some
> > stuff gets misfontified:
>
> Sorry, I have only been testing with level 4.
> This is also why I want type and module combined into one so we don't have to 
> deal with this headache.

I'm not quite sure what's the best choice here (keeping in mind the 
problem with overreaching variable highlights on level 4), but 
logically, I think 'module' belongs with 'function' and 'property' 
because all three denote some basic syntactic elements which are easy to 
understand even without colors, and are harder to make a mistake in.

That is in contrast with highlighting of variable declarations, for 
example, which in Rust can use some non-trivial syntax, more prone to 
user error.

> >    use std::collections::hash_map::{self, HashMap};
> >
> > 'hash_map' is highlighted as a type. 'HashMap' is not highlighted at all.
> >
> >    use std::{fmt, fs, usize};
> >
> > Only 'use' is highlighted here.
>
> This is because of how things are broken out into the module feature.
> That some highlighting for those occurs is by overlap of queries in the type 
> feature.
> Which again is why I think module should be part of type.
>
> >    test::test1();
> >
> > 'test1' is highlighted as a type (we discussed this problem with
> > highlighting types by default -- it becomes necessary to filter out
> > function calls, either with more complex queries, or with custom
> > highlighter functions).
>
> Right, I added a query to filter that out now.

Thanks, that works now.

> > 2. If I switch to treesit-font-lock-level 4:
> >
> >    let boxed_i32 = Box::new(5_i32);
> >
> > 'Box' is highlighted with font-lock-constant-face. I think it's a type,
> > though.
>
> Oops, I accidentally removed the rule for that. Added it back.

That too.

> > Also here's a pre-existing problem mentioned above:
> >
> >    use std::{fmt, fs, usize};
> >
> > 'fmt' and 'fs' are not types. But they are highlighted with
> > font-lock-type-face.
>
> This is really weird, I can reproduce it with emacs -Q but not with my normal 
> config...
> Also with emacs -Q this:
> let date = DateTime::<chrono::hey::there::Utc>::from_utc(date, 
> chrono::cool::this::Utc);
>
> highlights incorrectly, where "there" is font-lock-variable-name-face. But with 
> my normal config everything is fine.
>
> I'll look into it tomorrow. Not really sure what in my config could cause 
> this...

Thank you.

rust-github-dev.png
Description: PNG image

rust-intellij.png
Description: PNG image

rust-neovim.png
Description: PNG image

rust-vscode.png
Description: PNG image