2 Commits

Author	SHA1	Message	Date
comfyanonymous	88ed893034	Allow SPieceTokenizer to load model from a byte string.	2024-07-23 14:17:42 -04:00
comfyanonymous	14764aa2e2	Rename LLAMATokenizer to SPieceTokenizer.	2024-07-22 12:21:45 -04:00