Skip to main content

July 2022

Airbyte v0.39.27-alpha to v0.39.41-alpha​

This page includes new features and improvements to the Airbyte Cloud and Airbyte Open Source platforms.

New features​

  • Added per-stream state to the Airbyte Cloud and OSS platforms. Per-stream state currently includes per-stream resets and connection states, and it lays the groundwork for auto-detecting schema changes, parallel syncs, and more.

    • The new flow gives you the option to refresh streams when saving changes to a connection. #14634

    • Per-stream reset functionality is now available for connections with a Postgres source. Per-stream resets allow you to reset only the affected streams when saving an edited connection, instead of resetting all streams in a connection. #14634

    • For connections with a Postgres source, the state of the connection to the source is displayed in the Connection State. #15020

    • For Airbyte Open Source users:

      • If you are using the Postgres source connector, upgrade your Airbyte platform to version v0.40.0-alpha or newer and upgrade your AzureBlobStorage connector to version 0.1.6 or newer. #15008

  • Added airbyte_type to normalization. This displays whether timestamp and time have an associated time zone. #13591

  • Airbyte is currently developing a low-code connector builder, which allows you to easily create new source and destination connectors in your workspace. #14402 #14317 #14288 #14004

  • Added documentation about the benefits and considerations of having a single workspace vs. multiple workspaces in Airbyte Cloud. #14608

Improvements​

  • Improved platform security by using Docker images from the latest version of OpenJDK (openjdk:19-slim-bullseye). #14971

  • Improved Airbyte Open Source self-hosting by refactoring and publishing Helm charts according to best practices as we prepare to formally support Helm deployments. #14794

  • Improved Airbyte Open Source by supporting the OpenTelemetry (OTEL) Collector. Airbyte Open Source now sends telemetry data to the OTEL collector, and we included a set of recommended metrics to export to OTEL when running Airbyte Open Source at scale. #12908

  • Improved the Airbyte Connector Development Kit (CDK) by enabling detailed bug logs from the command line. In addition to the preset CDK debug logs, you can also create custom debug statements and display custom debug logs in the command line. #14521

  • Improved CDK by supporting a schema generator tool. #13518

  • Improved documentation about contributing locally by adding information on formatting connectors. #14661

  • Improved Octavia CLI so you can now:

    • Switch between Airbyte instances and deploy the same configurations on multiple instances. #13070 #13748

    • Enable normalization or custom DBT transformation from YAML configurations. #10973

    • Set custom HTTP headers on requests made to the Airbyte server. You can use CLI If you have instances secured with basic access authentication or identity-aware proxy (IAP). This lays the groundwork for making the CLI compatible with Airbyte Cloud once we release the public API. #13770

    • Import existing remote resources to a local Octavia project with octavia import. #14291

    • Use the get command to get existing configurations for sources, destinations, and connections. #13254

    • Retrieve the JSON configuration using octavia get, which is useful for some scripting and orchestration use cases. #13254

Was this page helpful?