跳到主要内容

v0.11.1

· 阅读需 4 分钟

Release date: December 21, 2024

👍 Highlights​

  • Supports label_join() and label_replace() for PromQL.
  • Supports pushing down IN filters.
  • Updates dashboard to v0.7.3

🚀 Features​

  • feat: adjust WAL purge default configurations by @killme2008 in #5107
  • feat(vector): add scalar add function by @zhongzc in #5119
  • feat: update dashboard to v0.7.2 by @ZonaHex in #5141
  • feat: implement v1/sql/parse endpoint to parse GreptimeDB's SQL dialect by @waynexia in #5144
  • feat: support push down IN filter by @NiwakaDev in #5129
  • feat: add prefetch support to PuffinFileFooterReader for reduced I/O time by @WenyXu in #5145
  • feat: add prefetch support to InvertedIndexFooterReader for reduced I/O time by @WenyXu in #5146
  • feat: introduce PuffinMetadataCache by @WenyXu in #5148
  • feat(fuzz): add alter table options for alter fuzzer by @CookiePieWw in #5074
  • feat(index): add file_size_hint for remote blob reader by @WenyXu in #5147
  • feat: collect reader metrics from prune reader by @evenyag in #5152
  • feat: Add vector_scalar_mul function. by @linyihai in #5166
  • feat: introduce SKIPPING index (part 1) by @waynexia in #5155
  • feat: update dashboard to v0.7.3 by @ZonaHex in #5172
  • feat(bloom-filter): add basic bloom filter creator (Part 1) by @zhongzc in #5177
  • feat: introduce Buffer for non-continuous bytes by @CookiePieWw in #5164
  • feat: impl label_join and label_replace for promql by @killme2008 in #5153
  • feat: do not keep MemtableRefs in ScanInput by @evenyag in #5184
  • feat: do not remove time filters in ScanRegion by @evenyag in #5180
  • feat: extract hints from http header by @fengjiachun in #5128
  • feat: show create postgresql foreign table by @sunng87 in #5143
  • feat: show flow's mem usage in INFORMATION_SCHEMA.FLOWS by @discord9 in #4890

🐛 Bug Fixes​

  • fix: loki write row len error by @paomian in #5161
  • fix: support alter table ~ add ~ custom_type by @NiwakaDev in #5165
  • fix: correct set_region_role_state_gracefully behaviors by @WenyXu in #5171
  • fix: deletion between two put may not work in last_non_null mode by @evenyag in #5168
  • fix: display inverted and fulltext index in show index by @lyang24 in #5169
  • fix(sqlness): enforce order in union tests by @v0y4g3r in #5190
  • fix: validate matcher op for name in promql by @waynexia in #5191
  • fix: ensure table route metadata is eventually rolled back on failure by @WenyXu in #5174
  • fix(flow): batch builder with type by @discord9 in #5195
  • fix: auto created table ttl check by @discord9 in #5203

🚜 Refactor​

📚 Documentation​

  • docs: Add index panels to standalone grafana dashboard by @evenyag in #5140
  • docs: fix grafana dashboard row by @evenyag in #5192

⚡ Performance​

🧪 Testing​

⚙️ Miscellaneous Tasks​

All Contributors​

We would like to thank the following contributors from the GreptimeDB community:

@CookiePieWw, @MichaelScofield, @NiwakaDev, @WenyXu, @ZonaHex, @discord9, @evenyag, @fengjiachun, @killme2008, @linyihai, @lyang24, @paomian, @shuiyisong, @sunng87, @v0y4g3r, @waynexia, @zhongzc

v0.11.2

· 阅读需 5 分钟

Release date: January 04, 2025

This version fixes the following critical issues:

  • Automatic alteration of the table may lead to inconsistent metadata.
  • Compaction doesn't use files in the local cache.

Notes​

This version modifies the default object storage cache paths:

  • The path for write cache has changed from the default {data_home}/object_cache/write to {data_home}/cache/object/write.
  • The path for read cache has changed from the default {data_home}/object_cache/read to {data_home}/cache/object/read.
  • When configuring write cache and read cache, only the root directory of the cache needs to be specified, which defaults to {data_home}.

We recommend that users no longer manually configure the cache paths after version 0.11, as the database can automatically set appropriate paths.

🚀 Features​

  • feat(bloom-filter): add memory control for creator by @zhongzc in #5185
  • feat(bloom-filter): add bloom filter reader by @zhongzc in #5204
  • feat(index-cache): abstract IndexCache to be shared by multi types of indexes by @zhongzc in #5219
  • feat: logs query endpoint by @waynexia in #5202
  • feat(mito): parquet memtable reader by @v0y4g3r in #4967
  • feat(bloom-filter): impl batch push to creator by @zhongzc in #5225
  • feat: introduce the Limiter in frontend to limit the requests by in-flight write bytes size. by @zyy17 in #5231
  • feat: add some critical metrics to flownode by @waynexia in #5235
  • feat(flow): check sink table mismatch on flow creation by @discord9 in #5112
  • feat: Add vec_mul function. by @linyihai in #5205
  • feat(bloom-filter): integrate indexer with mito2 by @zhongzc in #5236
  • feat(bloom-filter): bloom filter applier by @waynexia in #5220
  • feat(config): add bloom filter config by @zhongzc in #5237
  • feat(mito): add bloom filter read metrics by @zhongzc in #5239
  • feat: init PgElection with candidate registration by @CookiePieWw in #5209
  • feat(vector): add vector functions vec_sub & vec_sum & vec_elem_sum by @KKould in #5230
  • feat: add sqlness test for bloom filter index by @waynexia in #5240
  • feat: add vec_div function by @linyihai in #5245
  • feat: update partition duration of memtable using compaction window by @evenyag in #5197
  • feat: override __sequence on creating SST to save space and CPU by @waynexia in #5252
  • feat(log-query): implement pagination with limit and offset parameters by @waynexia in #5241
  • feat: hints all in one by @fengjiachun in #5194
  • feat: support add if not exists in the gRPC alter kind by @evenyag in #5273
  • feat: bump opendal and switch prometheus layer to the upstream impl by @waynexia in #5179

🐛 Bug Fixes​

🚜 Refactor​

  • refactor: remove unnecessary wrap by @WenyXu in #5221
  • refactor: support to convert time string to timestamp in convert_value() by @zyy17 in #5242
  • refactor: adjust index cache page size by @CookiePieWw in #5267
  • refactor: flow replace check&better error msg by @discord9 in #5277

📚 Documentation​

  • docs: add greptimedb-operator project link in 'Tools & Extensions' and other small improvements by @zyy17 in #5216

⚙️ Miscellaneous Tasks​

Build​

New Contributors​

All Contributors​

We would like to thank the following contributors from the GreptimeDB community:

@CookiePieWw, @KKould, @WenyXu, @chenmortal, @discord9, @evenyag, @fengjiachun, @linyihai, @nicecui, @paomian, @shuiyisong, @sunng87, @v0y4g3r, @waynexia, @yihong0618, @zhongzc, @zyy17

v0.11.0

· 阅读需 3 分钟

Release date: December 10, 2024

👍 Highlights​

  • Dashboard supports using a log view to explore logs.
  • Fixes performance regressions in v0.10.
  • Supports tables with TTL=instant as source tables for flow tasks.
  • Supports postgres_fdw to integrate GreptimeDB with existing PostgreSQL databases.

Breaking changes​

  • feat!: remove GET method in /debug path by @waynexia in #5102
  • fix!: fix regression caused by unbalanced partitions and splitting ranges by @evenyag in #5090
  • feat!: enable read cache and write cache when using remote object stores by @killme2008 in #5093

🚀 Features​

🐛 Bug Fixes​

  • fix(metric-engine): set ttl also on opening metadata regions by @v0y4g3r in #5051
  • fix: pass series row selector to file range reader by @evenyag in #5054
  • fix: allow physical region alter region options by @lyang24 in #5046
  • fix(flow): minor fix about count(*)&sink keyword by @discord9 in #5061
  • fix: correct is_exceeded_size_limit behavior for in-memory store by @WenyXu in #5082
  • fix: schema cache invalidation by @v0y4g3r in #5067
  • fix: put PipelineChecker at the end by @waynexia in #5092
  • fix: show create table doesn't quote option keys which contains dot by @killme2008 in #5108

🚜 Refactor​

  • refactor: expose configs for http clients used in object store by @MichaelScofield in #5041
  • refactor: remove built-in apidocs and schemars by @sunng87 in #5068
  • refactor: replace LogHandler with PipelineHandler by @waynexia in #5096
  • refactor: relocate CLI to a dedicated directory by @WenyXu in #5101
  • refactor: extract implicit conversion helper functions of vector type by @zhongzc in #5118

📚 Documentation​

⚡ Performance​

  • perf: take a new batch to reduce last row cache usage by @evenyag in #5095

🧪 Testing​

⚙️ Miscellaneous Tasks​

All Contributors​

We would like to thank the following contributors from the GreptimeDB community:

@MichaelScofield, @WenyXu, @ZonaHex, @discord9, @evenyag, @killme2008, @linyihai, @lyang24, @sunng87, @v0y4g3r, @waynexia, @zhongzc

v0.10.2

· 阅读需 8 分钟

Release date: November 26, 2024

👍 Highlights​

  • Vector type: GreptimeDB supports vector data types to optimize edge scenarios, such as IoT in vehicles, enabling efficient storage and computation of vector data for real-time perception and AI applications in smart driving.
  • Free index: Inverted indexes are no longer tied to primary keys, allowing users to create them on any column, enhancing query flexibility and efficiency across different scenarios.
  • Alter table options: Enhancements include setting TTL for databases and tables, modifying compaction parameters, and enabling/disabling full-text indexes on columns.
  • Loki remote write: GreptimeDB now supports the Loki remote write protocol, allowing users to log data in Loki format through Grafana tools.
  • Performance Optimization: Up to 10x improvement for queries fetching the latest N records by timestamp (ORDER BY timestamp DESC LIMIT N).
  • Remove the option: region_engine.mito.max_background_jobs and add three new options: region_engine.mito.max_background_flushes, region_engine.mito.max_background_compactions, and region_engine.mito.max_background_purges for more detailed configuration.

Breaking changes​

  • fix!: replace timeout_millis and connect_timeout_millis with Duration in DatanodeClientOptions by @WenyXu in #4867
  • feat!: Divide flush and compaction job pool by @evenyag in #4871

🚀 Features​

🐛 Bug Fixes​

🚜 Refactor​

🧪 Testing​

⚙️ Miscellaneous Tasks​

Build​

New Contributors​

All Contributors​

We would like to thank the following contributors from the GreptimeDB community:

@ActivePeter, @CookiePieWw, @Kev1n8, @MichaelScofield, @WenyXu, @ZonaHex, @discord9, @evenyag, @fengjiachun, @killme2008, @linyihai, @lyang24, @paomian, @shuiyisong, @sunng87, @v0y4g3r, @waynexia, @zhongzc, @zyy17

v0.10.1 (DEPRECATED)

· 阅读需 8 分钟

Release date: November 25, 2024

👍 Highlights​

  • Vector type: GreptimeDB supports vector data types to optimize edge scenarios, such as IoT in vehicles, enabling efficient storage and computation of vector data for real-time perception and AI applications in smart driving.
  • Free index: Inverted indexes are no longer tied to primary keys, allowing users to create them on any column, enhancing query flexibility and efficiency across different scenarios.
  • Alter table options: Enhancements include setting TTL for databases and tables, modifying compaction parameters, and enabling/disabling full-text indexes on columns.
  • Loki remote write: GreptimeDB now supports the Loki remote write protocol, allowing users to log data in Loki format through Grafana tools.
  • Performance Optimization: Up to 10x improvement for queries fetching the latest N records by timestamp (ORDER BY timestamp DESC LIMIT N).
  • Remove the option: region_engine.mito.max_background_jobs and add three new options: region_engine.mito.max_background_flushes, region_engine.mito.max_background_compactions, and region_engine.mito.max_background_purges for more detailed configuration.

Breaking changes​

  • fix!: replace timeout_millis and connect_timeout_millis with Duration in DatanodeClientOptions by @WenyXu in #4867
  • feat!: Divide flush and compaction job pool by @evenyag in #4871

🚀 Features​

🐛 Bug Fixes​

🚜 Refactor​

📚 Documentation​

🧪 Testing​

⚙️ Miscellaneous Tasks​

Build​

New Contributors​

All Contributors​

We would like to thank the following contributors from the GreptimeDB community:

@ActivePeter, @CookiePieWw, @Kev1n8, @MichaelScofield, @WenyXu, @ZonaHex, @discord9, @evenyag, @fengjiachun, @killme2008, @linyihai, @lyang24, @paomian, @shuiyisong, @sunng87, @v0y4g3r, @waynexia, @zhongzc, @zyy17

v0.10.0 (DEPRECATED)

· 阅读需 8 分钟

Release date: November 22, 2024

👍 Highlights​

  • Vector type: GreptimeDB supports vector data types to optimize edge scenarios, such as IoT in vehicles, enabling efficient storage and computation of vector data for real-time perception and AI applications in smart driving.
  • Free index: Inverted indexes are no longer tied to primary keys, allowing users to create them on any column, enhancing query flexibility and efficiency across different scenarios.
  • Alter table options: Enhancements include setting TTL for databases and tables, modifying compaction parameters, and enabling/disabling full-text indexes on columns.
  • Loki remote write: GreptimeDB now supports the Loki remote write protocol, allowing users to log data in Loki format through Grafana tools.
  • Performance Optimization: Up to 10x improvement for queries fetching the latest N records by timestamp (ORDER BY timestamp DESC LIMIT N).

Breaking changes​

  • fix!: replace timeout_millis and connect_timeout_millis with Duration in DatanodeClientOptions by @WenyXu in #4867
  • feat!: Divide flush and compaction job pool by @evenyag in #4871

🚀 Features​

🐛 Bug Fixes​

🚜 Refactor​

📚 Documentation​

🧪 Testing​

⚙️ Miscellaneous Tasks​

Build​

New Contributors​

All Contributors​

We would like to thank the following contributors from the GreptimeDB community:

@ActivePeter, @CookiePieWw, @Kev1n8, @MichaelScofield, @WenyXu, @ZonaHex, @discord9, @evenyag, @fengjiachun, @killme2008, @linyihai, @lyang24, @paomian, @shuiyisong, @sunng87, @v0y4g3r, @waynexia, @zhongzc, @zyy17

v0.9.5

· 阅读需 4 分钟

Release date: October 18, 2024

Highlights​

Breaking changes​

  • feat!: move v1/prof API to debug/prof by @evenyag in #4810
  • feat!: implement interval type by multiple structs by @evenyag in #4772

🚀 Features​

  • feat: protect datanode with concurrency limit. by @lyang24 in #4699
  • feat: add region_statistics table by @WenyXu in #4771
  • feat(mito): limit compaction output file size by @v0y4g3r in #4754
  • feat: add a new status code for "external" errors by @MichaelScofield in #4775
  • feat: unordered scanner scans data by time ranges by @evenyag in #4757
  • feat: add StatementStatistics for slow query logging implementation by @zyy17 in #4719
  • feat: support to reject write after flushing by @WenyXu in #4759
  • feat: add add_handler_after, add_handler_before, replace_handler by @WenyXu in #4788
  • feat: customize channel information for sqlness tests by @J0HN50N133 in #4729
  • feat: set max log files to 720 by default, info log only by @Kev1n8 in #4787
  • feat: introduce HeartbeatHandlerGroupBuilderCustomizer by @WenyXu in #4803
  • feat: add function to aggregate path into a geojson path by @sunng87 in #4798
  • feat: add json format output for http interface by @Kev1n8 in #4797
  • feat: Merge sort Logical plan by @discord9 in #4768
  • feat: json_path_exists udf by @CookiePieWw in #4807
  • feat: expose RegionMigrationManagerRef by @WenyXu in #4812
  • feat: information extension by @fengjiachun in #4811
  • feat: introduce LeadershipChangeNotifier and LeadershipChangeListener by @WenyXu in #4817
  • feat: add more h3 functions by @sunng87 in #4770
  • feat: remove the distributed lock by @fengjiachun in #4825
  • feat: enable prof features by default by @evenyag in #4815
  • feat: cache logical region's metadata by @waynexia in #4827
  • feat: defer HeartbeatHandlerGroup construction and enhance LeadershipChangeNotifier by @WenyXu in #4826
  • feat: add some s2 geo functions by @sunng87 in #4823
  • feat: introduce default customizers by @WenyXu in #4831

🐛 Bug Fixes​

🚜 Refactor​

  • refactor: Change the error type in the pipeline crate from String to Error by @paomian in #4763
  • refactor: introduce HeartbeatHandlerGroupBuilder by @WenyXu in #4785
  • refactor: change sqlness ports to avoid conflict with local instance by @sunng87 in #4794
  • refactor: replace info logs with debug logs in region server by @waynexia in #4829

📚 Documentation​

⚙️ Miscellaneous Tasks​

New Contributors​

All Contributors​

We would like to thank the following contributors from the GreptimeDB community:

@CookiePieWw, @J0HN50N133, @Kev1n8, @MichaelScofield, @WenyXu, @discord9, @evenyag, @fengjiachun, @lyang24, @paomian, @shuiyisong, @sunng87, @v0y4g3r, @waynexia, @zyy17

v0.9.4 (DEPRECATED)

· 阅读需 4 分钟

Release date: October 15, 2024

Highlights​

Breaking changes​

  • feat!: move v1/prof API to debug/prof by @evenyag in #4810
  • feat!: implement interval type by multiple structs by @evenyag in #4772

🚀 Features​

  • feat: protect datanode with concurrency limit. by @lyang24 in #4699
  • feat: add region_statistics table by @WenyXu in #4771
  • feat(mito): limit compaction output file size by @v0y4g3r in #4754
  • feat: add a new status code for "external" errors by @MichaelScofield in #4775
  • feat: unordered scanner scans data by time ranges by @evenyag in #4757
  • feat: add StatementStatistics for slow query logging implementation by @zyy17 in #4719
  • feat: support to reject write after flushing by @WenyXu in #4759
  • feat: add add_handler_after, add_handler_before, replace_handler by @WenyXu in #4788
  • feat: customize channel information for sqlness tests by @J0HN50N133 in #4729
  • feat: set max log files to 720 by default, info log only by @Kev1n8 in #4787
  • feat: introduce HeartbeatHandlerGroupBuilderCustomizer by @WenyXu in #4803
  • feat: add function to aggregate path into a geojson path by @sunng87 in #4798
  • feat: add json format output for http interface by @Kev1n8 in #4797
  • feat: Merge sort Logical plan by @discord9 in #4768
  • feat: json_path_exists udf by @CookiePieWw in #4807
  • feat: expose RegionMigrationManagerRef by @WenyXu in #4812
  • feat: information extension by @fengjiachun in #4811
  • feat: introduce LeadershipChangeNotifier and LeadershipChangeListener by @WenyXu in #4817
  • feat: add more h3 functions by @sunng87 in #4770
  • feat: remove the distributed lock by @fengjiachun in #4825
  • feat: enable prof features by default by @evenyag in #4815
  • feat: cache logical region's metadata by @waynexia in #4827
  • feat: defer HeartbeatHandlerGroup construction and enhance LeadershipChangeNotifier by @WenyXu in #4826
  • feat: add some s2 geo functions by @sunng87 in #4823
  • feat: introduce default customizers by @WenyXu in #4831

🐛 Bug Fixes​

🚜 Refactor​

  • refactor: Change the error type in the pipeline crate from String to Error by @paomian in #4763
  • refactor: introduce HeartbeatHandlerGroupBuilder by @WenyXu in #4785
  • refactor: change sqlness ports to avoid conflict with local instance by @sunng87 in #4794
  • refactor: replace info logs with debug logs in region server by @waynexia in #4829

📚 Documentation​

⚙️ Miscellaneous Tasks​

New Contributors​

All Contributors​

We would like to thank the following contributors from the GreptimeDB community:

@CookiePieWw, @J0HN50N133, @Kev1n8, @MichaelScofield, @WenyXu, @discord9, @evenyag, @fengjiachun, @lyang24, @paomian, @shuiyisong, @sunng87, @v0y4g3r, @waynexia, @zyy17

v0.9.3

· 阅读需 6 分钟

Release date: September 06, 2024

Highlights​

  • fixes the following issues
    • last_value function may return empty results due to cache #4652
    • query timestamp column in append mode misses some data #4669
    • crash while query tables with last_non_null merge mode #4687

Breaking changes​

🚀 Features​

🐛 Bug Fixes​

🚜 Refactor​

📚 Documentation​

⚡ Performance​

⚙️ Miscellaneous Tasks​

Build​

New Contributors​

All Contributors​

We would like to thank the following contributors from the GreptimeDB community:

@MichaelScofield, @WenyXu, @daviderli614, @discord9, @evenyag, @fengjiachun, @fengys1996, @killme2008, @leaf-potato, @lyang24, @ozewr, @paomian, @shuiyisong, @sunng87, @v0y4g3r, @waynexia, @zyy17

v0.9.2

· 阅读需 4 分钟

Release date: August 19, 2024

👍 Highlights​

  • #4545: Improve the performance of count(*) for append-only tables.
  • #4552: Allow more than one segment for full-text index to handle a large number of rows.

🚀 Features​

🐛 Bug Fixes​

🚜 Refactor​

  • refactor: reuse aligned ts array in range manipulate exec by @waynexia in #4535
  • refactor(plugin): add SetupPlugin and StartPlugin error by @zyy17 in #4554

📚 Documentation​

⚡ Performance​

  • perf: merge small byte ranges for optimized fetching by @WenyXu in #4520
  • perf: count(*) for append-only tables by @v0y4g3r in #4545
  • perf: Optimizing pipeline performance by @paomian in #4390

🧪 Testing​

⚙️ Miscellaneous Tasks​

Build​

All Contributors​

We would like to thank the following contributors from the GreptimeDB community:

@J0HN50N133, @MichaelScofield, @WenyXu, @daviderli614, @discord9, @evenyag, @fengjiachun, @leaf-potato, @lyang24, @paomian, @shuiyisong, @sunng87, @v0y4g3r, @waynexia, @zhongzc, @zyy17