Bruce MacDonald de0f833ce3 feat: timeout between token generation ...

- if 30 seconds pass since the last token generation abort the request
- stop the llama thread to flush any accumulated context

2024-03-15 16:19:54 +00:00

..

auth.go

rerefactor

2024-02-15 05:56:45 +00:00

download.go

Revert "adjust download and upload concurrency based on available bandwidth" (#2995)

2024-03-07 18:10:16 -08:00

fixblobs_test.go

server: replace blob prefix separator from ':' to '-' (#3146)

2024-03-14 20:18:06 -07:00

fixblobs.go

server: replace blob prefix separator from ':' to '-' (#3146)

2024-03-14 20:18:06 -07:00

images.go

server: replace blob prefix separator from ':' to '-' (#3146)

2024-03-14 20:18:06 -07:00

layers.go

server: replace blob prefix separator from ':' to '-' (#3146)

2024-03-14 20:18:06 -07:00

llm_image_test.go

Guard integration tests with a tag

2023-12-22 16:33:27 -08:00

llm_test.go

Guard integration tests with a tag

2023-12-22 16:33:27 -08:00

llm_utils_test.go

Guard integration tests with a tag

2023-12-22 16:33:27 -08:00

manifests.go

add .golangci.yaml

2024-01-09 09:36:58 -08:00

modelpath_test.go

use int64 consistently

2023-09-28 11:07:24 -07:00

modelpath.go

server: replace blob prefix separator from ':' to '-' (#3146)

2024-03-14 20:18:06 -07:00

prompt_test.go

prepend image tags (#2789)

2024-02-29 11:30:14 -08:00

prompt.go

prepend image tags (#2789)

2024-02-29 11:30:14 -08:00

routes_test.go

add allowed host middleware and remove workDir middleware (#3018)

2024-03-08 22:23:47 -08:00

routes.go

feat: timeout between token generation

2024-03-15 16:19:54 +00:00

upload.go

Revert "adjust download and upload concurrency based on available bandwidth" (#2995)

2024-03-07 18:10:16 -08:00