small batches for summarization (#245)

<!-- This is an auto-generated comment: release notes by openai -->
### Summary by OpenAI

Release Notes:

- Performance: Default timeout for OpenAI API calls reduced from 180000
to 120000 milliseconds. Batch size used for summarizing files in
`review.ts` changed from 20 to 10.
- User Experience: Added instructions and context to the review process
in `prompts.ts`.

> "Code quality improved, 
> Performance enhanced, 
> Review process streamlined, 
> Our codebase now advanced."
<!-- end of auto-generated comment: release notes by openai -->

Author: harjotgill

action.yml

@@ -79,7 +79,7 @@ inputs:
   openai_timeout_ms:
     required: false
     description: 'Timeout for OpenAI API call in millis'
-    default: '180000'
+    default: '120000'
   openai_concurrency_limit:
     required: false
     description: 'How many concurrent API calls to make to OpenAI servers?'

dist/index.js

@@ -155,8 +155,10 @@ Instructions:
   \`<line_number><colon><whitespace>\`.
 - Your task is to review ONLY the new hunks line by line, ONLY pointing out 
   substantive issues within line number ranges. Provide the exact line 
-  number range (inclusive) for each issue. Focus on identifying specific 
-  issues and avoid summarizing changes or providing general feedback.
+  number range (inclusive) for each issue. Consider additional context 
+  provided by old hunks, comment chains and the file content while 
+  reviewing the new hunks. Focus on identifying specific issues and 
+  avoid summarizing changes or providing general feedback. 
 - IMPORTANT: Respond only in the response format (consisting of review 
   sections). Each review section must have a line number range and a review 
   comment for that range. Do not include general feedback or summaries. You 

src/prompts.ts

@@ -346,10 +346,11 @@ ${hunks.oldHunk}
   ) as Array<[string, string, boolean]>
 
   if (summaries.length > 0) {
-    // join summaries into one in the batches of 20
+    const batchSize = 10
+    // join summaries into one in the batches of batchSize
     // and ask the bot to summarize the summaries
-    for (let i = 0; i < summaries.length; i += 20) {
-      const summariesBatch = summaries.slice(i, i + 20)
+    for (let i = 0; i < summaries.length; i += batchSize) {
+      const summariesBatch = summaries.slice(i, i + batchSize)
       for (const [filename, summary] of summariesBatch) {
         inputs.rawSummary += `---
 ${filename}: ${summary}