20 Commits

Author	SHA1	Message	Date
jmorganca	de634b7fd7	fix issues with runner	2024-09-03 21:15:13 -04:00
jmorganca	795753be7e	move sync script back in for now	2024-09-03 21:15:13 -04:00
jmorganca	8f79a2e86a	cleanup stop code	2024-09-03 21:15:13 -04:00
jmorganca	7d0a452938	num predict	2024-09-03 21:15:13 -04:00
jmorganca	43efc893d7	basic progress	2024-09-03 21:15:13 -04:00
jmorganca	20afaae020	add more runner params	2024-09-03 21:15:13 -04:00
jmorganca	72f3fe4b94	truncate stop properly	2024-09-03 21:15:13 -04:00
jmorganca	a379d68aa9	wip stop tokens	2024-09-03 21:15:13 -04:00
jmorganca	b2ef3bf490	embeddings	2024-09-03 21:15:12 -04:00
jmorganca	ce15ed6d69	remove dependency on llm	2024-09-03 21:15:12 -04:00
jmorganca	c0b94376b2	grammar	2024-09-03 21:15:12 -04:00
jmorganca	72be8e27c4	sampling	2024-09-03 21:15:12 -04:00
jmorganca	d12db0568e	better example module, add port	2024-09-03 21:15:12 -04:00
jmorganca	ec17359a68	wip	2024-09-03 21:15:12 -04:00
jmorganca	fbc8572859	add llava to runner	2024-09-03 21:15:12 -04:00
jmorganca	a8f91d3cc1	add llava	2024-09-03 21:15:12 -04:00
jmorganca	9fe48978a8	move runner package down	2024-09-03 21:15:12 -04:00
jmorganca	01ccbc07fe	replace static build in llm	2024-09-03 21:15:12 -04:00
jmorganca	6129f30479	wip...	2024-09-03 21:15:12 -04:00
jmorganca	eb1aa97961	rename server to runner	2024-09-03 21:15:12 -04:00