This week in Databend #11

Databend aimed to be an open source elastic and reliable cloud warehouse, it offers blazing fast query and combines elasticity, simplicity, low cost of the cloud, built to make the Data Cloud easy.

Big changes

Below is a list of some major changes that we don’t want you to miss.

Features

  • new features for cli by @ZhiHanZ, like
    • local profile for meta service bootstrap (#1981)
    • auto complete scripts (#2171)
  • add aggregate covariance functions by @junli1026 (#2042)
  • cast functions between String and Date16/Date32/DateTime32 by @sundy-li. (#2075)

Improvement

Bug fixes

Changlogs

You can check the changelogs of Databend nightly to learn about our latest developments.

Meet Us

Please join the DatafuseLabs Community if you are interested in Databend.

We are looking forward to seeing you try our code. We have a strong team behind you to ensure a smooth experience in trying our code for your projects. If you are a hacker passionate about database internals, feel free to play with our code.

You can submit issues for any problems you find. We also highly appreciate any of your pull requests.

This week in Databend #10

Databend aimed to be an open source elastic and reliable cloud warehouse, it offers blazing fast query and combines elasticity, simplicity, low cost of the cloud, built to make the Data Cloud easy.

Big changes

Below is a list of some major changes that we don’t want you to miss.

Features

Improvement

Changlogs

You can check the changelogs of Databend nightly to learn about our latest developments.

Meet Us

Please join the DatafuseLabs Community if you are interested in Databend.

We are looking forward to seeing you try our code. We have a strong team behind you to ensure a smooth experience in trying our code for your projects. If you are a hacker passionate about database internals, feel free to play with our code.

You can submit issues for any problems you find. We also highly appreciate any of your pull requests.

This week in Databend #9

Databend aimed to be an open source elastic and reliable cloud warehouse, it offers blazing fast query and combines elasticity, simplicity, low cost of the cloud, built to make the Data Cloud easy.

Big changes

Below is a list of some major changes that we don’t want you to miss.

Features

Refactor

  • a series of refactorings around common-kv (kvlocal) by @drmingdrmer, like
    • move local kv into standalone crate /kvlocal to break potential cyclic dependency (#1926)
    • kv-local no longer depends on metasrv (#1960)
  • sync style Api Provider and KVApi by @dantengsky. (#1939)
  • split store API into more fine-grained crates by @dantengsky. (#1952)
  • move sled based store into a standalone crate by @drmingdrmer. (#1953)

Improvement

  • reduce 90% release & 70% debug binary size on linux toolchains
    • strip the binary size, x86_64-unknown-linux-gnu by @PsiACE. (#1959)
    • update docker and striped arm release, aarch64-unknown-linux-gnu by @ZhiHanZ. (#1969)
  • introduce the query/users for all the user operations in high level by @BohuTANG. (#1978)
  • make config clearer by @BohuTANG.(#1989)
  • make date32 physical type to be int32 by @sundy-li. (#1990)

Changlogs

You can check the changelogs of Databend nightly to learn about our latest developments.

Meet Us

Please join the DatafuseLabs Community if you are interested in Databend.

We are looking forward to seeing you try our code. We have a strong team behind you to ensure a smooth experience in trying our code for your projects. If you are a hacker passionate about database internals, feel free to play with our code.

You can submit issues for any problems you find. We also highly appreciate any of your pull requests.

This week in Databend #8

Databend aimed to be an open source elastic and reliable cloud warehouse, it offers blazing fast query and combines elasticity, simplicity, low cost of the cloud, built to make the Data Cloud easy.

Big changes

Below is a list of some major changes that we don’t want you to miss.

Features

Refactor

  • split metasrv and store by @drmingdrmer. (#1879)
  • a series of refactorings around metasrv by @drmingdrmer, like
    • extract state machine into dir metasrv/raft/state_machine (#1910)
    • remove unused meta API: db, table etc. (#1914)

Improvement

Bug fixes

Changlogs

You can check the changelogs of Databend nightly to learn about our latest developments.

Meet Us

Please join the DatafuseLabs Community if you are interested in Databend.

We are looking forward to seeing you try our code. We have a strong team behind you to ensure a smooth experience in trying our code for your projects. If you are a hacker passionate about database internals, feel free to play with our code.

You can submit issues for any problems you find. We also highly appreciate any of your pull requests.

This week in Databend #7

Databend aimed to be an open source elastic and reliable cloud warehouse, it offers blazing fast query and combines elasticity, simplicity, low cost of the cloud, built to make the Data Cloud easy.

Big changes

Below is a list of some major changes that we don’t want you to miss.

Refactor

Features

Bug fixes

  • fix count function with not null column by @zhang2014. (#1794)
  • fix insert remote table of parquet format with DateTime types by @sundy-li. (#1765)
  • fix unary arithmetics function err fix unary arithmetics function err by @zhyass. (#1842)

RFCs

Changlogs

You can check the changelogs of Databend nightly to learn about our latest developments.

Ecosystem/Upstream

From open source, for open source. Our team is also committed to contributing to the Rust ecosystem and upstream dependencies.

Meet Us

Please join the DatafuseLabs Community if you are interested in Databend.

We are looking forward to seeing you try our code. We have a strong team behind you to ensure a smooth experience in trying our code for your projects. If you are a hacker passionate about database internals, feel free to play with our code.

You can submit issues for any problems you find. We also highly appreciate any of your pull requests.

This week in Datafuse #6

Datafuse is an open source elastic and scalable cloud warehouse, it offers blazing fast query and combines elasticity, simplicity, low cost of the cloud, built to make the Data Cloud easy.

Big changes

Below is a list of some major changes that we don’t want you to miss.

Changlogs

You can check the changelogs of Datafuse nightly to learn about our latest developments.

Ecosystem/Upstream

From open source, for open source. The Datafuse team is also committed to contributing to the Rust ecosystem and upstream dependencies.

Meet Us

Please join the Datafuse Community if you are interested in Datafuse.

We are looking forward to seeing you try our code. We have a strong team behind you to ensure a smooth experience in trying our code for your projects. If you are a hacker passionate about database internals, feel free to play with our code. You can submit issues for any problems you find. We also highly appreciate any of your pull requests.

This week in Datafuse #5

Datafuse is an open source elastic and scalable cloud warehouse, it offers blazing fast query and combines elasticity, simplicity, low cost of the cloud, built to make the Data Cloud easy.

Big changes

Below is a list of some major changes that we don’t want you to miss.

Changlogs

You can check the changelogs of Datafuse nightly to learn about our latest developments.

Ecosystem/Upstream

From open source, for open source. The Datafuse team is also committed to contributing to the Rust ecosystem and upstream dependencies.

Thanks

Thanks to your contribution, datafuse becomes better!

Meet Us

Please join the Datafuse Community if you are interested in Datafuse.

We are looking forward to seeing you try our code. We have a strong team behind you to ensure a smooth experience in trying our code for your projects. If you are a hacker passionate about database internals, feel free to play with our code. You can submit issues for any problems you find. We also highly appreciate any of your pull requests.

This week in Datafuse #4

Datafuse is an open source elastic and scalable cloud warehouse, it offers blazing fast query and combines elasticity, simplicity, low cost of the cloud, built to make the Data Cloud easy.

Big changes

Below is a list of some major changes that we don’t want you to miss.

Changlogs

You can check the changelogs of Datafuse nightly to learn about our latest developments.

Ecosystem/Upstream

From open source, for open source. The Datafuse team is also committed to contributing to the Rust ecosystem and upstream dependencies.

Thanks

Thanks to your contribution, datafuse becomes better!

  • @jyz0309:Add parser used time metric (#1586) and add optimize histogram metric (#1524)
  • @mapleFU: Support SHOW TABLES LIKE pattern and Where expr (#1518) and add SHOW TABLES LIKE pattern and Where expr to doc (#1541)
  • @dust1: Add Support SHOW TABLES FROM statament (#1555)

Meet Us

Please join the Datafuse Community if you are interested in Datafuse.

We are looking forward to seeing you try our code. We have a strong team behind you to ensure a smooth experience in trying our code for your projects. If you are a hacker passionate about database internals, feel free to play with our code. You can submit issues for any problems you find. We also highly appreciate any of your pull requests.

This week in Datafuse #3

Datafuse is an open source elastic and scalable cloud warehouse, it offers blazing fast query and combines elasticity, simplicity, low cost of the cloud, built to make the Data Cloud easy.

Big changes

Below is a list of some major changes that we don’t want you to miss.

Changlogs

You can check the changelogs of Datafuse nightly to learn about our latest developments.

Thanks

Thanks to your contribution, datafuse becomes better!

  • @junli1026:Fix read_opt_scalar and add test (#1446) and add test for array builder (#1468)
  • @yjhmelody: Fix variadic_arguments of LogicFunction (#1486)
  • @koushiro: Use #[from] attribute of thiserror::Error proc macro, and remove some boilerplate code (#1507)
  • @jackwener: Send slack notification when performance tests standalone start, fail or success (#1450)

Meet Us

Please join the Datafuse Community if you are interested in Datafuse.

We are looking forward to seeing you try our code. We have a strong team behind you to ensure a smooth experience in trying our code for your projects. If you are a hacker passionate about database internals, feel free to play with our code. You can submit issues for any problems you find. We also highly appreciate any of your pull requests.

This week in Datafuse #2

Datafuse, is a Modern Real-Time Data Processing & Analytics DBMS with a Cloud-Native Architecture, built to make the Data Cloud easy.

Big changes

Below is a list of some major changes that we don’t want you to miss.

Changlogs

You can check the changelogs of Datafuse nightly to learn about our latest developments.

Ecosystem/Upstream

From open source, for open source. The Datafuse team is also committed to contributing to the Rust ecosystem and upstream dependencies.

Thanks

Thanks to your contribution, datafuse becomes better!

Meet Us

Please join the Datafuse Community if you are interested in Datafuse.

We are looking forward to seeing you try our code. We have a strong team behind you to ensure a smooth experience in trying our code for your projects. If you are a hacker passionate about database internals, feel free to play with our code. You can submit issues for any problems you find. We also highly appreciate any of your pull requests.