Michael Yang
4dc5b117dd
automatically set num_keep if num_keep < 0
...
num_keep defines how many tokens to keep in the context when truncating
inputs. if left to its default value of -1, the server will calculate
num_keep to be the left of the system instructions
2023-08-07 16:19:12 -07:00
..
2023-08-03 11:50:24 -07:00
2023-08-03 11:50:24 -07:00
2023-08-03 11:50:24 -07:00
2023-08-03 11:50:24 -07:00
2023-08-03 11:50:24 -07:00
2023-08-03 11:50:24 -07:00
2023-08-03 11:50:24 -07:00
2023-08-03 11:50:24 -07:00
2023-08-03 11:50:24 -07:00
2023-08-03 11:50:24 -07:00
2023-08-03 11:50:24 -07:00
2023-08-03 11:50:24 -07:00
2023-08-03 11:50:24 -07:00
2023-08-03 11:50:24 -07:00
2023-08-03 11:50:24 -07:00
2023-08-02 12:50:30 -07:00
2023-08-03 11:50:24 -07:00
2023-08-03 11:50:24 -07:00
2023-08-07 16:19:12 -07:00
2023-08-03 11:50:24 -07:00
2023-07-28 08:07:48 -04:00
2023-07-27 09:31:44 -07:00