Frequently Asked Questions
What would be the use cases for a time-series database?
Common use cases for time-series database include but are not limited to the following four scenarios:
- Monitor applications and infrastructure
- Store and access IoT data
- Process self-driving vehicle data
- Understand financial trends
How is GreptimeDB's performance compared to other solutions?
GreptimeDB has released v0.7, with functionalities set to improve progressively. For detailed TSBS test results, refer to the link below: https://github.com/GreptimeTeam/greptimedb/blob/main/docs/benchmarks/tsbs/v0.7.0.md.
How is the performance of GreptimeDB when used for non-time-series DB tables?
GreptimeDB supports SQL and can deal with non-time-series data, especially efficient for high concurrent and throughput data writing. However, we develop GreptimeDB for a specific domain (time-series scenarios), and it doesn't support transactions and can't delete data efficiently.
Does GreptimeDB have a Go driver?
Yes, you can find our Go SDK here: https://github.com/GreptimeTeam/greptimedb-ingester-go.
Currently, we support MySQL protocol, you can check it out on the user guide.
HTTP API is also available, please see this article for more information.
Can GreptimeDB be used as a Rust alternative to Prometheus in the observable area?
GreptimeDB has initially implemented native support for PromQL, with compatibility in GreptimeDB v0.7 surpassing 80%, making it comparable to VictoriaMetrics.
Is GreptimeDB compatible with Grafana?
Yes, It's compatible with Grafana.
GreptimeDB supports MySQL and PostgreSQL protocol, so you can use MySQL or PG grafana plugin to config GreptimeDB as a datasource. Then you can use SQL to query the data.
Also, we are implementing PromQL natively which is frequently used with Grafana.
How does this compare to Loki? Is there a crate with Rust bindings available, preferably as tracing or logging subscriber?
GreptimeDB is currently focused on the development of Metrics-related features. However, our Greptime 2024 Roadmap has already announced the release plan for the Log Engine, which is expected to be implemented in version 1.1.
For more information: https://github.com/GreptimeTeam/greptimedb/issues/3412
When will GreptimeDB release its first GA version?
The current version has not yet reached General Availability version standards. In line with our Greptime 2024 Roadmap, we plan to achieve a production-level version with the update to v1.0 in August. More details: https://github.com/GreptimeTeam/greptimedb/issues/3412.
Are there any plans/works done for the official UI for GreptimeDB so that it would be possible to check cluster status, list of tables, statistics etc？
Yes, we open sourced the dashboard for users to query and visualize their data. Please check out our initial version on GitHub Repo.
Does GreptimeDB support schemaless?
Yes, GreptimeDB is a schemaless database without need for creating tables in advance. The table and columns will be created automatically when writing data with protocol gRPC, InfluxDB, OpentsDB, Prometheus remote write.
For more information, refer to this document.
How do you measure the passing rate of PromQL compatibility tests? Is there any testing framework？
There’s an issue to track the PromQL compatibility tests passing rate. It's based on Prometheus's compliance test.
Where’s the name “Greptime” coming from?
Because “grep” is the most useful command line tool on *nix platform to search data, and time means time series. So Greptime is to help everybody to search/find value in time series data.
Is there any good first issue that can help beginners get started quickly?
Yes, beginners can filter issues with "good first issue" label. Additionally, more good first issues will be released on a rolling basis, so stay tuned!
Does GreptimeDB support dumping table-level data to S3?
You can use the COPY TO command to dump table-level data to S3.
TSDB features that you concern
Please refer to features that you concern.
Can https://n9e.github.io/ now be directly integrated with GreptimeDB? How is its compatibility?
Currently, GreptimeDB's compatibility efforts are primarily focused on the implementation of native PromQL. Going forward, we will continue to enhance compatibility with MetricQL's extended syntax.
Should I use the command "drop database" to delete a database?
Yes, that is the intended command. However, 'drop database' will be implemented in v0.8. It is expected to be included in the next minor iterative update. As a result, there is no direct way to delete a database at the moment. You may consider creating a new database for testing purposes. If you're working with test data, you also have the option to clear it by deleting the data directory.
Are there any retention policy?
We have implemented table level Time-To-Live (TTL) in this PR. You can refer to the TTL option of the table build statement here.
What are the main differences between Greptime and another time-series database built on DataFusion like InfluxDB?
At GreptimeDB, we share some technical similarities with InfluxDB, both using Datafusion, Arrow, Parquet, and built on object storage. However, we differ in several key aspects:
Open-Source Strategy: Unlike InfluxDB, which only open-sources its standalone version, our entire distributed cluster version is open-source. Our architecture can even run on edge Android systems.
Distributed Architecture: Our architecture is more aligned with HBase's Region/RegionServer design. Our Write-Ahead Log (WAL) uses Kafka, and we're exploring a quorum-based implementation in the future.
Workload and Services: We focus on a hybrid workload combining time series and analytics. This integration aims to enhance resource efficiency and real-time performance for users. We also offer GreptimeCloud, a commercial cloud service.
Storage Engine Design: Our pluggable storage engine is versatile. For scenarios with many small data tables, like in Prometheus, we have a dedicated Metrics storage engine.
Query Language Support: We support PromQL for observability and SQL for data analysis, and incorporate Python for complex data processing. InfluxDB, on the other hand, uses InfluxQL and SQL.
We're a young, rapidly evolving project and always looking to improve. For more details, visit our Blog and Contributor Guide. We welcome your interest and contributions!
As a first-timer looking to contribute to GreptimeDB, where can I find a comprehensive guide to get started?
Welcome! Please refer to our contribution guide. For those new to GreptimeDB, we have a selected collection of good first issues. Feel free to reach us in Slack channel anytime!
I'm considering using GreptimeDB for a large-scale metrics system similar to Facebook's Gorilla or Google's Monarch, with a preference for in-memory data and high availability, possibly at the expense of some data loss. Given GreptimeDB's focus on consistency over in-memory storage, are there plans to introduce options like asynchronous WAL or optional disk storage for flexibility? Also, is there a way to ensure data replication without WAL, and when can we expect documentation and features for tiered storage?
GreptimeDB already supports asynchronous WAL, and we're looking into a per-table WAL toggle for more control. We're also developing a tiered storage approach, starting with in-memory caching. For data replication, we ensure that data flushed to remote stores like S3 is replicated, independent of WAL. The details for tiered storage are tracked in issue #2516. We provide a remote WAL implementation based on Apache Kafka to ensure the durability of data not being flushed in cluster mode.
Does GreptimeDB have a way to handle absolute counters that can reset, like InfluxDB's non-negative differential? How do aggregations work with these counters, and is PromQL preferred over SQL for them? Also, is there a plan to integrate PromQL functions into SQL, similar to InfluxDB v3?
GreptimeDB, like Prometheus, handles counters effectively. Functions like reset(), rate(), or delta() in GreptimeDB are designed to automatically detect and adjust for counter resets. While it's not recommended to use the deriv() function on a counter since it's meant for gauges, you can apply rate() to your counter and then use deriv(). PromQL is indeed more suitable for operations involving counters, given its origin in Prometheus. However, we are exploring the integration of PromQL functions into SQL for greater flexibility. If you're interested in implementing functions into GreptimeDB, we have documentation available which you can check out: Greptime Documentation.