unexpected-keyboard/srcs/compose/compile.py, branch skintones Unnamed repository; edit this file 'description' to name the repository. Better suggestion with diacritics (#1223) 2026-04-10T17:08:23+00:00 Jules Aguillon 2026-04-10T17:08:23+00:00 833b4a21549f7ea8067291f344f6acdeaff3f079 * Update cdict * scripts/subst_of_compose.py: Compute substitutions from compose mappings. They are used when building dictionaries. * Add substitutions compose data * Better suggestion with diacritics This improves the suggestions for words that contain diacritics and uppercase letters. This works by stripping diacritics both when building the dictionaries (using word aliases added in cdict: https://github.com/Julow/cdict/pull/3) and during lookup. Cdict then takes care of resolving the correct word. The substitutions are generated using mappings from `fn`, `shift` and all the `accent_*` modifiers into srcs/compose/substitutions.json This can be updated easily when more mappings are added. 
* Update cdict

* scripts/subst_of_compose.py: Compute substitutions

from compose mappings. They are used when building dictionaries.

* Add substitutions compose data

* Better suggestion with diacritics

This improves the suggestions for words that contain diacritics and
uppercase letters.

This works by stripping diacritics both when building the dictionaries
(using word aliases added in cdict: https://github.com/Julow/cdict/pull/3)
and during lookup. Cdict then takes care of resolving the correct word.

The substitutions are generated using mappings from `fn`, `shift` and
all the `accent_*` modifiers into srcs/compose/substitutions.json
This can be updated easily when more mappings are added.
 compose: Add compose+A+e as compose+A+E and many others 2025-05-15T22:59:35+00:00 Jules Aguillon 2025-05-15T22:59:35+00:00 a7312054b56ad3bdbc62d03c774b5942db9852e9 compile.py is changed to report when compose+Upper+Upper exists but compse+Upper+Lower do not. With these findings, many sequences are added. 
compile.py is changed to report when compose+Upper+Upper exists but
compse+Upper+Lower do not.

With these findings, many sequences are added.
Compose: Allow to force string final states 2024-12-18T23:59:27+00:00 Jules Aguillon 2024-12-17T10:27:09+00:00 82e472ba469c44272e6e3cfd5b9e047a7121ef68 Appending the ':' character to a sequence result forces it to be a string final state. This will cause a KeyValue lookup that would normally not happen for single-character results. This is useful to make Tamil letters smaller, even when they are the result of a Shift. 
Appending the ':' character to a sequence result forces it to be a
string final state. This will cause a KeyValue lookup that would
normally not happen for single-character results.
This is useful to make Tamil letters smaller, even when they are the
result of a Shift.
compose: Fix parsing of long sequences from json files 2024-12-18T23:34:24+00:00 Jules Aguillon 2024-12-18T23:34:24+00:00 4a429357ef9faa409617f867e224bc8c6814d919 Sequences longer than two characters were not read correctly from json files, creating conflicts and causing dropped sequences. The detection of collision in sequences is also improved. Two colliding sequences are removed. 
Sequences longer than two characters were not read correctly from json
files, creating conflicts and causing dropped sequences.

The detection of collision in sequences is also improved. Two colliding
sequences are removed.
Add Fn layer and Compose sequences for Cyrillic 2024-09-29T20:47:57+00:00 Jules Aguillon 2024-09-29T20:47:57+00:00 9f0cf15d2e5eee9eb255d4a10969b5cb0d76c864 






compose: Deduplicate end states
2024-09-14T13:13:04+00:00

Jules Aguillon

2024-09-14T13:13:04+00:00

b61e9db21e2898f9a1cedcfc4f93e88094551723

Make compose sequences ending in the same character to share the ending
state.
This reduce the compiled compose key data size from 33kB to 27kB.





Make compose sequences ending in the same character to share the ending
state.
This reduce the compiled compose key data size from 33kB to 27kB.







compose: Allow c-style comments in json files
2024-09-10T20:43:05+00:00

Jules Aguillon

2024-09-10T20:43:05+00:00

e734d1d0e240e19c978c5ce26d171277fe3cb85a

Useful to manager growing the collection of sequences.





Useful to manager growing the collection of sequences.







Allow extending the compose key (#713)
2024-07-21T21:37:07+00:00

Jules Aguillon

2024-07-21T21:37:07+00:00

2696f42144f42b1c4c270555047d40095693d3c4

This allows adding more compose sequences without modifying
en_US_UTF_8_Compose.pre.

This is done by grouping sequences files that should be merged together
into a directory. This also allows moving keysymdef.h into that
directory.




This allows adding more compose sequences without modifying
en_US_UTF_8_Compose.pre.

This is done by grouping sequences files that should be merged together
into a directory. This also allows moving keysymdef.h into that
directory.






compose: Compile several starting states
2024-06-09T09:52:17+00:00

Jules Aguillon

2024-06-09T09:10:20+00:00

ecac6a77f8954269b76ecbf5c6fa7f5fda65242f

Sequences from several files are no longer merged but compiled to
separate starting states.

The plan is to use that to represent the diacritics.





Sequences from several files are no longer merged but compiled to
separate starting states.

The plan is to use that to represent the diacritics.







compose: Fix misbehaving due to encoding errors
2024-06-09T08:35:38+00:00

Jules Aguillon

2024-06-09T08:35:38+00:00

a886f6eedeafbe06c6de0cf68fbd0f81655af597

Encoding errors in the compose data compiler due to:
- 'UTF-16' adds a BOM, use 'UTF-16-LE' instead
- 'str.encode' returns a byte array, use 'array' to have a 16-bit char
  array.





Encoding errors in the compose data compiler due to:
- 'UTF-16' adds a BOM, use 'UTF-16-LE' instead
- 'str.encode' returns a byte array, use 'array' to have a 16-bit char
  array.