When using --deep-crawl, output all pages, not just the first one.

[christian-oudard]

Summary

There is a bug in crwl --deep-crawl, where it will only output the first crawled page in markdown format.

List of files changed and why

• crawl4ai/cli.py, the fix
• tests/cli/test_cli.py, the tests for it

How Has This Been Tested?

Manual testing on various websites. Unittests.

Checklist:

• My code follows the style guidelines of this project
• I have performed a self-review of my own code
• I have commented my code, particularly in hard-to-understand areas
• I have made corresponding changes to the documentation
• I have added/updated unit tests that prove my fix is effective or that my feature works
• New and existing unit tests pass locally with my changes