跳到主要内容

v0.11.0

· 阅读需 3 分钟

Release date: December 10, 2024

👍 Highlights​

  • Dashboard supports using a log view to explore logs.
  • Fixes performance regressions in v0.10.
  • Supports tables with TTL=instant as source tables for flow tasks.
  • Supports postgres_fdw to integrate GreptimeDB with existing PostgreSQL databases.

Breaking changes​

  • feat!: remove GET method in /debug path by @waynexia in #5102
  • fix!: fix regression caused by unbalanced partitions and splitting ranges by @evenyag in #5090
  • feat!: enable read cache and write cache when using remote object stores by @killme2008 in #5093

🚀 Features​

🐛 Bug Fixes​

  • fix(metric-engine): set ttl also on opening metadata regions by @v0y4g3r in #5051
  • fix: pass series row selector to file range reader by @evenyag in #5054
  • fix: allow physical region alter region options by @lyang24 in #5046
  • fix(flow): minor fix about count(*)&sink keyword by @discord9 in #5061
  • fix: correct is_exceeded_size_limit behavior for in-memory store by @WenyXu in #5082
  • fix: schema cache invalidation by @v0y4g3r in #5067
  • fix: put PipelineChecker at the end by @waynexia in #5092
  • fix: show create table doesn't quote option keys which contains dot by @killme2008 in #5108

🚜 Refactor​

  • refactor: expose configs for http clients used in object store by @MichaelScofield in #5041
  • refactor: remove built-in apidocs and schemars by @sunng87 in #5068
  • refactor: replace LogHandler with PipelineHandler by @waynexia in #5096
  • refactor: relocate CLI to a dedicated directory by @WenyXu in #5101
  • refactor: extract implicit conversion helper functions of vector type by @zhongzc in #5118

📚 Documentation​

⚡ Performance​

  • perf: take a new batch to reduce last row cache usage by @evenyag in #5095

🧪 Testing​

⚙️ Miscellaneous Tasks​

All Contributors​

We would like to thank the following contributors from the GreptimeDB community:

@MichaelScofield, @WenyXu, @ZonaHex, @discord9, @evenyag, @killme2008, @linyihai, @lyang24, @sunng87, @v0y4g3r, @waynexia, @zhongzc

v0.10.2

· 阅读需 8 分钟

Release date: November 26, 2024

👍 Highlights​

  • Vector type: GreptimeDB supports vector data types to optimize edge scenarios, such as IoT in vehicles, enabling efficient storage and computation of vector data for real-time perception and AI applications in smart driving.
  • Free index: Inverted indexes are no longer tied to primary keys, allowing users to create them on any column, enhancing query flexibility and efficiency across different scenarios.
  • Alter table options: Enhancements include setting TTL for databases and tables, modifying compaction parameters, and enabling/disabling full-text indexes on columns.
  • Loki remote write: GreptimeDB now supports the Loki remote write protocol, allowing users to log data in Loki format through Grafana tools.
  • Performance Optimization: Up to 10x improvement for queries fetching the latest N records by timestamp (ORDER BY timestamp DESC LIMIT N).
  • Remove the option: region_engine.mito.max_background_jobs and add three new options: region_engine.mito.max_background_flushes, region_engine.mito.max_background_compactions, and region_engine.mito.max_background_purges for more detailed configuration.

Breaking changes​

  • fix!: replace timeout_millis and connect_timeout_millis with Duration in DatanodeClientOptions by @WenyXu in #4867
  • feat!: Divide flush and compaction job pool by @evenyag in #4871

🚀 Features​

🐛 Bug Fixes​

🚜 Refactor​

🧪 Testing​

⚙️ Miscellaneous Tasks​

Build​

New Contributors​

All Contributors​

We would like to thank the following contributors from the GreptimeDB community:

@ActivePeter, @CookiePieWw, @Kev1n8, @MichaelScofield, @WenyXu, @ZonaHex, @discord9, @evenyag, @fengjiachun, @killme2008, @linyihai, @lyang24, @paomian, @shuiyisong, @sunng87, @v0y4g3r, @waynexia, @zhongzc, @zyy17

v0.10.1 (DEPRECATED)

· 阅读需 8 分钟

Release date: November 25, 2024

👍 Highlights​

  • Vector type: GreptimeDB supports vector data types to optimize edge scenarios, such as IoT in vehicles, enabling efficient storage and computation of vector data for real-time perception and AI applications in smart driving.
  • Free index: Inverted indexes are no longer tied to primary keys, allowing users to create them on any column, enhancing query flexibility and efficiency across different scenarios.
  • Alter table options: Enhancements include setting TTL for databases and tables, modifying compaction parameters, and enabling/disabling full-text indexes on columns.
  • Loki remote write: GreptimeDB now supports the Loki remote write protocol, allowing users to log data in Loki format through Grafana tools.
  • Performance Optimization: Up to 10x improvement for queries fetching the latest N records by timestamp (ORDER BY timestamp DESC LIMIT N).
  • Remove the option: region_engine.mito.max_background_jobs and add three new options: region_engine.mito.max_background_flushes, region_engine.mito.max_background_compactions, and region_engine.mito.max_background_purges for more detailed configuration.

Breaking changes​

  • fix!: replace timeout_millis and connect_timeout_millis with Duration in DatanodeClientOptions by @WenyXu in #4867
  • feat!: Divide flush and compaction job pool by @evenyag in #4871

🚀 Features​

🐛 Bug Fixes​

🚜 Refactor​

📚 Documentation​

🧪 Testing​

⚙️ Miscellaneous Tasks​

Build​

New Contributors​

All Contributors​

We would like to thank the following contributors from the GreptimeDB community:

@ActivePeter, @CookiePieWw, @Kev1n8, @MichaelScofield, @WenyXu, @ZonaHex, @discord9, @evenyag, @fengjiachun, @killme2008, @linyihai, @lyang24, @paomian, @shuiyisong, @sunng87, @v0y4g3r, @waynexia, @zhongzc, @zyy17

v0.10.0 (DEPRECATED)

· 阅读需 8 分钟

Release date: November 22, 2024

👍 Highlights​

  • Vector type: GreptimeDB supports vector data types to optimize edge scenarios, such as IoT in vehicles, enabling efficient storage and computation of vector data for real-time perception and AI applications in smart driving.
  • Free index: Inverted indexes are no longer tied to primary keys, allowing users to create them on any column, enhancing query flexibility and efficiency across different scenarios.
  • Alter table options: Enhancements include setting TTL for databases and tables, modifying compaction parameters, and enabling/disabling full-text indexes on columns.
  • Loki remote write: GreptimeDB now supports the Loki remote write protocol, allowing users to log data in Loki format through Grafana tools.
  • Performance Optimization: Up to 10x improvement for queries fetching the latest N records by timestamp (ORDER BY timestamp DESC LIMIT N).

Breaking changes​

  • fix!: replace timeout_millis and connect_timeout_millis with Duration in DatanodeClientOptions by @WenyXu in #4867
  • feat!: Divide flush and compaction job pool by @evenyag in #4871

🚀 Features​

🐛 Bug Fixes​

🚜 Refactor​

📚 Documentation​

🧪 Testing​

⚙️ Miscellaneous Tasks​

Build​

New Contributors​

All Contributors​

We would like to thank the following contributors from the GreptimeDB community:

@ActivePeter, @CookiePieWw, @Kev1n8, @MichaelScofield, @WenyXu, @ZonaHex, @discord9, @evenyag, @fengjiachun, @killme2008, @linyihai, @lyang24, @paomian, @shuiyisong, @sunng87, @v0y4g3r, @waynexia, @zhongzc, @zyy17

v0.9.5

· 阅读需 4 分钟

Release date: October 18, 2024

Highlights​

Breaking changes​

  • feat!: move v1/prof API to debug/prof by @evenyag in #4810
  • feat!: implement interval type by multiple structs by @evenyag in #4772

🚀 Features​

  • feat: protect datanode with concurrency limit. by @lyang24 in #4699
  • feat: add region_statistics table by @WenyXu in #4771
  • feat(mito): limit compaction output file size by @v0y4g3r in #4754
  • feat: add a new status code for "external" errors by @MichaelScofield in #4775
  • feat: unordered scanner scans data by time ranges by @evenyag in #4757
  • feat: add StatementStatistics for slow query logging implementation by @zyy17 in #4719
  • feat: support to reject write after flushing by @WenyXu in #4759
  • feat: add add_handler_after, add_handler_before, replace_handler by @WenyXu in #4788
  • feat: customize channel information for sqlness tests by @J0HN50N133 in #4729
  • feat: set max log files to 720 by default, info log only by @Kev1n8 in #4787
  • feat: introduce HeartbeatHandlerGroupBuilderCustomizer by @WenyXu in #4803
  • feat: add function to aggregate path into a geojson path by @sunng87 in #4798
  • feat: add json format output for http interface by @Kev1n8 in #4797
  • feat: Merge sort Logical plan by @discord9 in #4768
  • feat: json_path_exists udf by @CookiePieWw in #4807
  • feat: expose RegionMigrationManagerRef by @WenyXu in #4812
  • feat: information extension by @fengjiachun in #4811
  • feat: introduce LeadershipChangeNotifier and LeadershipChangeListener by @WenyXu in #4817
  • feat: add more h3 functions by @sunng87 in #4770
  • feat: remove the distributed lock by @fengjiachun in #4825
  • feat: enable prof features by default by @evenyag in #4815
  • feat: cache logical region's metadata by @waynexia in #4827
  • feat: defer HeartbeatHandlerGroup construction and enhance LeadershipChangeNotifier by @WenyXu in #4826
  • feat: add some s2 geo functions by @sunng87 in #4823
  • feat: introduce default customizers by @WenyXu in #4831

🐛 Bug Fixes​

🚜 Refactor​

  • refactor: Change the error type in the pipeline crate from String to Error by @paomian in #4763
  • refactor: introduce HeartbeatHandlerGroupBuilder by @WenyXu in #4785
  • refactor: change sqlness ports to avoid conflict with local instance by @sunng87 in #4794
  • refactor: replace info logs with debug logs in region server by @waynexia in #4829

📚 Documentation​

⚙️ Miscellaneous Tasks​

New Contributors​

All Contributors​

We would like to thank the following contributors from the GreptimeDB community:

@CookiePieWw, @J0HN50N133, @Kev1n8, @MichaelScofield, @WenyXu, @discord9, @evenyag, @fengjiachun, @lyang24, @paomian, @shuiyisong, @sunng87, @v0y4g3r, @waynexia, @zyy17

v0.9.4 (DEPRECATED)

· 阅读需 4 分钟

Release date: October 15, 2024

Highlights​

Breaking changes​

  • feat!: move v1/prof API to debug/prof by @evenyag in #4810
  • feat!: implement interval type by multiple structs by @evenyag in #4772

🚀 Features​

  • feat: protect datanode with concurrency limit. by @lyang24 in #4699
  • feat: add region_statistics table by @WenyXu in #4771
  • feat(mito): limit compaction output file size by @v0y4g3r in #4754
  • feat: add a new status code for "external" errors by @MichaelScofield in #4775
  • feat: unordered scanner scans data by time ranges by @evenyag in #4757
  • feat: add StatementStatistics for slow query logging implementation by @zyy17 in #4719
  • feat: support to reject write after flushing by @WenyXu in #4759
  • feat: add add_handler_after, add_handler_before, replace_handler by @WenyXu in #4788
  • feat: customize channel information for sqlness tests by @J0HN50N133 in #4729
  • feat: set max log files to 720 by default, info log only by @Kev1n8 in #4787
  • feat: introduce HeartbeatHandlerGroupBuilderCustomizer by @WenyXu in #4803
  • feat: add function to aggregate path into a geojson path by @sunng87 in #4798
  • feat: add json format output for http interface by @Kev1n8 in #4797
  • feat: Merge sort Logical plan by @discord9 in #4768
  • feat: json_path_exists udf by @CookiePieWw in #4807
  • feat: expose RegionMigrationManagerRef by @WenyXu in #4812
  • feat: information extension by @fengjiachun in #4811
  • feat: introduce LeadershipChangeNotifier and LeadershipChangeListener by @WenyXu in #4817
  • feat: add more h3 functions by @sunng87 in #4770
  • feat: remove the distributed lock by @fengjiachun in #4825
  • feat: enable prof features by default by @evenyag in #4815
  • feat: cache logical region's metadata by @waynexia in #4827
  • feat: defer HeartbeatHandlerGroup construction and enhance LeadershipChangeNotifier by @WenyXu in #4826
  • feat: add some s2 geo functions by @sunng87 in #4823
  • feat: introduce default customizers by @WenyXu in #4831

🐛 Bug Fixes​

🚜 Refactor​

  • refactor: Change the error type in the pipeline crate from String to Error by @paomian in #4763
  • refactor: introduce HeartbeatHandlerGroupBuilder by @WenyXu in #4785
  • refactor: change sqlness ports to avoid conflict with local instance by @sunng87 in #4794
  • refactor: replace info logs with debug logs in region server by @waynexia in #4829

📚 Documentation​

⚙️ Miscellaneous Tasks​

New Contributors​

All Contributors​

We would like to thank the following contributors from the GreptimeDB community:

@CookiePieWw, @J0HN50N133, @Kev1n8, @MichaelScofield, @WenyXu, @discord9, @evenyag, @fengjiachun, @lyang24, @paomian, @shuiyisong, @sunng87, @v0y4g3r, @waynexia, @zyy17

v0.9.3

· 阅读需 6 分钟

Release date: September 06, 2024

Highlights​

  • fixes the following issues
    • last_value function may return empty results due to cache #4652
    • query timestamp column in append mode misses some data #4669
    • crash while query tables with last_non_null merge mode #4687

Breaking changes​

🚀 Features​

🐛 Bug Fixes​

🚜 Refactor​

📚 Documentation​

⚡ Performance​

⚙️ Miscellaneous Tasks​

Build​

New Contributors​

All Contributors​

We would like to thank the following contributors from the GreptimeDB community:

@MichaelScofield, @WenyXu, @daviderli614, @discord9, @evenyag, @fengjiachun, @fengys1996, @killme2008, @leaf-potato, @lyang24, @ozewr, @paomian, @shuiyisong, @sunng87, @v0y4g3r, @waynexia, @zyy17

v0.9.2

· 阅读需 4 分钟

Release date: August 19, 2024

👍 Highlights​

  • #4545: Improve the performance of count(*) for append-only tables.
  • #4552: Allow more than one segment for full-text index to handle a large number of rows.

🚀 Features​

🐛 Bug Fixes​

🚜 Refactor​

  • refactor: reuse aligned ts array in range manipulate exec by @waynexia in #4535
  • refactor(plugin): add SetupPlugin and StartPlugin error by @zyy17 in #4554

📚 Documentation​

⚡ Performance​

  • perf: merge small byte ranges for optimized fetching by @WenyXu in #4520
  • perf: count(*) for append-only tables by @v0y4g3r in #4545
  • perf: Optimizing pipeline performance by @paomian in #4390

🧪 Testing​

⚙️ Miscellaneous Tasks​

Build​

All Contributors​

We would like to thank the following contributors from the GreptimeDB community:

@J0HN50N133, @MichaelScofield, @WenyXu, @daviderli614, @discord9, @evenyag, @fengjiachun, @leaf-potato, @lyang24, @paomian, @shuiyisong, @sunng87, @v0y4g3r, @waynexia, @zhongzc, @zyy17

v0.9.1

· 阅读需 5 分钟

Release date: August 02, 2024

This is a patch release, containing some important bug fixes:

  • #4447: Full-text search may miss some rows when a full-text index is applied.
  • #4476: Data ingestion can stall due to missing notifications.

It's highly recommended to upgrade to this version if you're using v0.9.0.

Breaking changes​

  • refactor!: Remove Mode from FrontendOptions by @zyy17 in #4401

🚀 Features​

🐛 Bug Fixes​

  • fix: ensure keep alive is completed in time by @WenyXu in #4349
  • fix: user provider can't be configured by config file or environment variables by @zyy17 in #4398
  • fix: dictionary key type use u32 by @evenyag in #4396
  • fix(wal): handle WAL deletion on region drop by @v0y4g3r in #4400
  • fix: add back AuthBackend which is required by custom auth backend by @sunng87 in #4409
  • fix(fulltext-index): clean up 0-value timer by @zhongzc in #4423
  • fix(metrics): RowGroupLastRowCachedReader metrics by @v0y4g3r in #4418
  • fix: information_schema tables and views column value by @killme2008 in #4438
  • fix: remove to_timezone function by @killme2008 in #4439
  • fix: use heartbeat runtime instead of background runtime by @WenyXu in #4445
  • fix(fulltext-search): prune rows in row group forget to take remainder by @zhongzc in #4447
  • fix: use status code to http status mapping in error IntoResponse by @shuiyisong in #4455
  • fix: missing pre_write check on prometheus remote write by @shuiyisong in #4460
  • fix: check_partition uses unqualified name by @waynexia in #4452
  • fix: overflow when parsing default value with negative numbers by @killme2008 in #4459
  • fix: prometheus api only returns 200 by @shuiyisong in #4471
  • fix: generate unique timestamp for inserting tests by @WenyXu in #4472
  • fix: notify flush receiver after write buffer is released by @evenyag in #4476
  • fix: avoid total size overflow by @evenyag in #4487

🚜 Refactor​

  • refactor: add &mut Plugins argument in plugins setup api and remove unnecessary mut by @zyy17 in #4389
  • refactor: add get_storage_path() and get_catalog_and_schema() by @zyy17 in #4397
  • refactor(query): Remove PhysicalPlanner trait by @leaf-potato in #4412
  • refactor: Remove PhysicalOptimizer and LogicalOptimizer trait by @leaf-potato in #4426
  • refactor: add RetryInterceptor to print detailed error by @zyy17 in #4434
  • refactor(servers): improve postgres error message by @leaf-potato in #4463

📚 Documentation​

⚡ Performance​

⚙️ Miscellaneous Tasks​

New Contributors​

All Contributors​

We would like to thank the following contributors from the GreptimeDB community:

@J0HN50N133, @MichaelScofield, @WenyXu, @ZonaHex, @discord9, @evenyag, @fengjiachun, @killme2008, @leaf-potato, @realtaobo, @shuiyisong, @sunng87, @v0y4g3r, @waynexia, @zhongzc, @zyy17

v0.9.0

· 阅读需 11 分钟

Release date: July 16, 2024

👍 Highlights​

  • Log Engine: GreptimeDB is now a unified time-series database for both metrics, logs, and events (trace in plan).
  • Remote WAL is significantly improved and is now recommended to turn on.
  • Table View: You can now CREATE VIEW on tables and treat them as logical table.
  • Short interval literal for user experience.
  • InfluxDB Merge Read: You can now use the merge_mode=last_non_null table option to allow SELECT result merges all the last non-null fields.
  • gRPC TLS: You can now set up the grpc.tls config to turn on TLS for gRPC connection.
  • Manually Compact in Strict Window: You can now use SELECT COMPACT_TABLE("monitor", "strict_window", "3600"); to manually schedule a compaction task, splitting SST files strictly into time windows. The third option is the time window's width in seconds.

Breaking changes​

  • refactor!: unify FrontendOptions and DatanodeOptions by using GrpcOptions by @realtaobo in #4088
  • feat!: reduce sorted runs during compaction by @v0y4g3r in #3702
  • fix!: forbid to change information_schema by @CookiePieWw in #4233
  • feat!: remove alias metasrv-addr by @discord9 in #4239
  • feat!: Set merge mode while creating table in influx handler by @evenyag in #4299

🚀 Features​

🐛 Bug Fixes​

  • fix(sqlness): catch different format timestamp by @WenyXu in #4149
  • fix: region logical regions after catching up by @WenyXu in #4176
  • fix(flow): fix call df func bug&sqlness test by @discord9 in #4165
  • fix: region_peers returns same region_id for multi logical tables by @realtaobo in #4190
  • fix(sql): improve compound signed number processing by @etolbakov in #4200
  • fix: align workflows again for the troublesome GHA by @waynexia in #4196
  • fix: format error correctly by @WenyXu in #4204
  • fix: wrong frontend registration address by @killme2008 in #4199
  • fix: add serialize_ignore_column_ids() to fix deserialize region options failed from json string by @zyy17 in #4229
  • fix(puffin): fix dependency by @v0y4g3r in #4267
  • fix(fuzz): generate valid string by @WenyXu in #4281
  • fix: enhance ColumnOption::DefaultValue formatting for string values by @WenyXu in #4287
  • fix: enable space string in yaml value by @shuiyisong in #4286
  • fix: align pre-commit config with make file by @shuiyisong in #4292
  • fix: call df_func with literal by @discord9 in #4265
  • fix: prepare inserting with column defaults not work, #4244 by @killme2008 in #4272
  • fix: deregister failure detector in region migration by @WenyXu in #4293
  • fix(ci): remove sqlness state in success by @waynexia in #4313
  • fix: test_fulltext_intm_path by @zhongzc in #4314
  • fix: error on show databases in non-default catalog by @sunng87 in #4316
  • fix: panic while reading information_schema. KEY_COLUMN_USAGE by @killme2008 in #4318
  • fix: support unary operator in default value, partition rule and prepare statement by @waynexia in #4301
  • fix(sqlness): relax start time regex to match various precisions by @waynexia in #4326
  • fix: permission denied is 403 by @sunng87 in #4350
  • fix(config): enable file engine by default by @WenyXu in #4345
  • fix: build info should use build time env var by @tisonkun in #4343
  • fix: remove path label for cache store by @sunng87 in #4336
  • fix: scan hint checks order asc by @evenyag in #4365

🚜 Refactor​

  • refactor: add Compactor trait to abstract the compaction by @zyy17 in #4097
  • refactor: make region manifest checkpoint ran in background by @MichaelScofield in #4133
  • refactor: Decouple dedup and merge by @evenyag in #4139
  • refactor: make RegionOptions and MergeOutput serializable by @zyy17 in #4180
  • refactor: add region_dir in CompactionRegion by @zyy17 in #4187
  • refactor: migrate region failover implementation to region migration by @WenyXu in #4172
  • refactor: add SerializedPickerOutput and field modification of CompactorRequest by @zyy17 in #4198
  • refactor(flow): make from_substrait_* async& worker handle refactor by @discord9 in #4210
  • refactor: expose DatanodeBuilder::build_object_store_manager() and MitoConfig::sanitize() by @zyy17 in #4212
  • refactor: use ObjectStoreManagerRef type in open_compaction_region() and add related unit test by @zyy17 in #4238
  • refactor: add interceptor after Influxdb lines are converted to grpc row insert by @MichaelScofield in #4225
  • refactor: add RemoteCompaction error by @zyy17 in #4251
  • refactor: change InvertedIndexWriter method signature to offsets to f… by @v0y4g3r in #4250
  • refactor(puffin): adjust generic parameters by @zhongzc in #4279
  • refactor: use rwlock for modifiable session data by @sunng87 in #4232
  • refactor(inverted_index): integrate puffin manager with sst indexer by @zhongzc in #4285
  • refactor: split match arms in prom_expr_to_plan into smaller methods by @waynexia in #4317
  • refactor: do not print error log on PlanQuery error by @sunng87 in #4322
  • refactor: Remove the StandaloneKafkaConfig struct by @irenjj in #4253
  • refactor: LastRowReader to use LastRowSelector by @v0y4g3r in #4374

📚 Documentation​

⚡ Performance​

🧪 Testing​

⚙️ Miscellaneous Tasks​

◀️ Revert​

Build​

All Contributors​

We would like to thank the following contributors from the GreptimeDB community:

@CookiePieWw, @J0HN50N133, @MichaelScofield, @WenyXu, @ZonaHex, @discord9, @etolbakov, @evenyag, @fengjiachun, @irenjj, @killme2008, @lyang24, @paomian, @realtaobo, @shuiyisong, @sunng87, @tisonkun, @v0y4g3r, @waynexia, @yuanbohan, @zhongzc, @zyy17