shelley/server: reduce custom model test timeout to 10 seconds

Philip Zeyliger and Shelley created 2 months ago

Prompt: Fix https://github.com/boldsoftware/shelley/issues/57 in a new worktree. The issue is with the Test button for custom models; should definitely have a ~10 second timeout.

Fixes https://github.com/boldsoftware/shelley/issues/57

Co-authored-by: Shelley <[e-mail]>

Change summary

server/custom_models.go | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)

Detailed changes

server/custom_models.go

@@ -382,7 +382,7 @@ func (s *Server) handleTestModel(w http.ResponseWriter, r *http.Request) {
 	}
 
 	// Send a simple test request
-	ctx, cancel := context.WithTimeout(r.Context(), 30*time.Second)
+	ctx, cancel := context.WithTimeout(r.Context(), 10*time.Second)
 	defer cancel()
 
 	request := &llm.Request{