Streams process data piece by piece, enabling efficient handling of large files and real-time data without loading everything into memory.
Stream Types#
Readable: Source of data (fs.createReadStream, http request)
Writable: Destination for data (fs.createWriteStream, http response)
Duplex: Both readable and writable (TCP socket)
Transform: Modify data as it passes through (compression, encryption)
Reading Streams#
Loading code block...
Writing Streams#
Loading code block...
Transform Streams#
Loading code block...
Pipeline#
Loading code block...
HTTP Streaming#
Loading code block...
Async Generators#
Loading code block...
Backpressure#
Loading code block...
Object Mode Streams#
Loading code block...
Best Practices#
Memory:
✓ Use streams for large files
✓ Set appropriate highWaterMark
✓ Handle backpressure
✓ Clean up on error
Error Handling:
✓ Always handle 'error' events
✓ Use pipeline for cleanup
✓ Destroy streams on error
✓ Check stream state
Performance:
✓ Tune chunk size for workload
✓ Use object mode for objects
✓ Avoid unnecessary transforms
✓ Profile memory usage
Conclusion#
Streams enable efficient data processing in Node.js. Use pipeline for composing streams safely, handle backpressure to prevent memory issues, and leverage async iteration for cleaner code. Streams are essential for processing large files and real-time data.