Age | Commit message (Collapse) | Author | |
---|---|---|---|
2023-09-11 | refactor utilities (data, vis, tokenizer) | Pherkel | |
2023-09-11 | readd space token, idk why its there but it could break things | Pherkel | |
2023-09-11 | improved tokenizer | Pherkel | |
2023-09-06 | deleted a TODO | JoJoBarthold2 | |
2023-09-04 | please the linter | Pherkel | |
2023-09-04 | applied fixes to download and tokenizers | Philipp Merkel | |
2023-09-03 | reformat, remove deps | Pherkel | |
2023-09-03 | idk, hopefully this works | Pherkel | |
2023-09-01 | many todos | Pherkel | |
2023-08-24 | wip: commit before going on vacation :) | Pherkel | |
2023-08-21 | adjust char tokenizer interface | Pherkel | |
2023-08-20 | please the linters | Pherkel | |
2023-08-20 | added todos | Pherkel | |
2023-08-20 | Merge branch 'main' into tokenizer | Pherkel | |
2023-08-20 | added tokenizer training | Pherkel | |