We are happy to present the Apache Beam Python I/O connector for Amazon Data Firehose 0.2.1 release.

♻️UPDATE

  • Return failed elements by a tagged output, which allows users to determine how to handle them subsequently.
  • Provide options that handle failed records.
    • max_trials - The maximum number of trials when there is one or more failed records.
    • append_error - Whether to append error details to failed records.

See this post for more examples.