|
|
f67c00622f
|
Use inference_mode instead of no_grad.
|
2023-03-22 03:48:26 -04:00 |
|
|
|
5c55c93367
|
Updated to reuse session id if available
|
2023-03-07 13:24:15 +00:00 |
|
|
|
c8ce599a8f
|
Add a button to interrupt processing to the ui.
|
2023-03-02 15:24:51 -05:00 |
|
|
|
69cc75fbf8
|
Add a way to interrupt current processing in the backend.
|
2023-03-02 14:42:03 -05:00 |
|
|
|
5f0f97634f
|
Only clear cuda cache on CUDA since it causes slowdowns on ROCm.
|
2023-02-28 13:39:30 -05:00 |
|
|
|
cd85f876f2
|
Try to clear more memory at the end of each prompt execution.
|
2023-02-28 11:56:33 -05:00 |
|
|
|
49d2e5bb5a
|
Move some stuff from main.py to execution.py
|
2023-02-27 19:44:58 -05:00 |
|
