Commits · main · Erdenebileg Byambadorj / localzmn · GitLab

Snippets Groups Projects

Apr 25, 2025
- Fix: SentencePiece underscore fixed · 6f4c9208
  brainylark authored 3 weeks ago
  
  6f4c9208
- Fix: alphabet bytes arranged to highest cyrillic ranks · e95bfb20
  brainylark authored 3 weeks ago
  
  e95bfb20
- Fix: alphabet bytes arranged to highest cyrillic ranks · 6980594b
  brainylark authored 3 weeks ago
  
  6980594b
- Fix: Alphabetic bytes rearranged to higher ranks · 84dd092c
  brainylark authored 3 weeks ago
  
  84dd092c
Apr 24, 2025
- Special broken rules fixed. New tokens set after special tokens · d3de7804
  brainylark authored 4 weeks ago
  
  d3de7804
- Special edge cases fixed Yu Yo · 0985ee82
  brainylark authored 4 weeks ago
  
  0985ee82
- Merge rules cyrillic fixed · a71d3aa4
  brainylark authored 4 weeks ago
  
  a71d3aa4
Apr 23, 2025
- Merging done · 8df781cc
  brainylark authored 4 weeks ago
  
  8df781cc
- Localisation into Qwen tokenizer Mongolian tokens and merge rules added · 9a4566ba
  brainylark authored 4 weeks ago
  
  9a4566ba
Apr 22, 2025
- Merging script added alongside with training · e7d3f991
  brainylark authored 1 month ago
  
  e7d3f991
- Merge branch 'main' of https://git.bolor.net/Erdenebileg/localzmn into main · 6c202144
  brainylark authored 1 month ago
  
  6c202144
- Initial commit · a6fc9a62
  brainylark authored 1 month ago
  
  a6fc9a62
- Initial commit · a9f04c39
  Erdenebileg Byambadorj authored 1 month ago
  
  a9f04c39