Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Classify tokens according to semantic-highlighting proposal

See original GitHub issue

https://github.com/microsoft/vscode-languageserver-node/blob/324d1039fef2b9622a9784c5cc49d9f6dfc11b65/protocol/src/protocol.sematicTokens.proposed.ts

export enum SemanticTokenTypes {
	comment = 'comment',
	keyword = 'keyword',
	string = 'string',
	number = 'number',
	regexp = 'regexp',
	operator = 'operator',
	namespace = 'namespace',
	type = 'type',
	struct = 'struct',
	class = 'class',
	interface = 'interface',
	enum = 'enum',
	typeParameter = 'typeParameter',
	function = 'function',
	member = 'member',
	property = 'property',
	macro = 'macro',
	variable = 'variable',
	parameter = 'parameter',
	label = 'label'
}

Issue Analytics

State:
Created 4 years ago
Reactions:1
Comments:5 (2 by maintainers)

Top GitHub Comments

4reactions

EvgeniyPeshkovcommented, Apr 29, 2020

Hello guys. It seems the time has come. As I can see, there is a new semantic token api (in fact I’m not really sure how new it is (= ). Looks like quite a thing, I was waiting for it for a long time. I believe it’s much faster than decorations. Also it’ll keep highlighting in sync with themes. So looks like many problems are to be resolved. I’m planning to adopt semantic token api, meaning almost completely rewrite the extension. I’m quite busy at the moment, but will make it ASAP.

0reactions

razzeeecommented, Jul 12, 2020

Are you planning to incorporate tree-sitters highlighting? https://tree-sitter.github.io/tree-sitter/syntax-highlighting There only seems to be a rust/c api

Top Results From Across the Web

Semantic Highlight Guide | Visual Studio Code Extension API

Semantic tokenization allows language servers to provide additional token information based on the language server's knowledge on how to resolve symbols in the ......

[semantic] proposals for new standard semantic token types

The new semantic token provider API comes with a list of standard token types and modifiers.

STViT: Semantic Tokens for Efficient Global and Local Vision ...

This paper proposes a novel semantic token ViTs for efficient global and local vision transformers, which reduce most FLOPS and achieve faster ...

How to manage your Design Tokens with Style Dictionary

Style Dictionary has an implicit classification of the tokens: ... According to the documentation “you can organize and name your style properties however ......

Chapter 2 - Tokens and Python's Lexical Structure - ICS, UCI

Learn the syntax and semantics of Python's five lexical categories ... characters and translates them into a sequence of tokens, classifying each by....