Handle Large File Inputs and Performance Optimization

[yusuftomilola]

Ensure the PDF generation service can handle large or complex inputs efficiently without timeouts or excessive resource consumption.

---

Details

• Test system with large HTML/Markdown inputs (e.g., 100+ pages worth of content).
• Profile CPU, memory, and response time during conversions.
• If necessary, implement streaming PDF generation or chunked processing.
• Evaluate asynchronous job queue approach (e.g., using BullMQ or RabbitMQ) for heavy loads, returning a job ID and polling endpoint.
• Document any input size or complexity limits in the API docs.
• Add timeouts and safeguards to avoid server crashes.

---

Subtasks

• Benchmark and profile service with large inputs.
• Implement async job queue if needed.
• Add timeout handling and limits.
• Update docs with performance guidelines.

---

Acceptance Criteria

• Large inputs processed without crashing or excessive delay.
• Service maintains reasonable resource usage under load.
• Documentation reflects current limits and best practices.

[KAMALDEEN333]

Hi can i work on this