Michael Yang 4dc5b117dd automatically set num_keep if num_keep < 0
num_keep defines how many tokens to keep in the context when truncating
inputs. if left to its default value of -1, the server will calculate
num_keep to be the left of the system instructions
2023-08-07 16:19:12 -07:00
..
2023-08-03 11:50:24 -07:00
2023-08-03 11:50:24 -07:00
2023-08-03 11:50:24 -07:00
2023-08-03 11:50:24 -07:00
2023-08-03 11:50:24 -07:00
2023-08-03 11:50:24 -07:00
2023-08-03 11:50:24 -07:00
2023-08-03 11:50:24 -07:00
2023-08-03 11:50:24 -07:00
2023-08-03 11:50:24 -07:00
2023-08-03 11:50:24 -07:00
2023-08-03 11:50:24 -07:00
2023-08-03 11:50:24 -07:00
2023-08-03 11:50:24 -07:00
2023-08-03 11:50:24 -07:00
2023-08-03 11:50:24 -07:00
2023-08-03 11:50:24 -07:00
2023-08-03 11:50:24 -07:00
2023-07-27 09:31:44 -07:00