PingCAP
  • Cloud
  • TiDB Academy
  • Docs
  • Success Stories
  • Blog
  • Free Download
PingCAP
  • Cloud
  • TiDB Academy
  • Docs
  • Success Stories
  • Blog
  • Free Download

Contact

中文
Weekly
  • 2019(48)
    • 2019-12(2)
      • Weekly update (December 02 ~ December 08, 2019)
      • Weekly update (November 25 ~ December 01, 2019)
    • 2019-11(4)
      • Weekly update (November 18 ~ November 24, 2019)
      • Weekly update (November 11 ~ November 17, 2019)
      • Weekly update (November 04 ~ November 10, 2019)
      • Weekly update (October 28 ~ November 03, 2019)
    • 2019-10(3)
      • Weekly update (October 21 ~ October 27, 2019)
      • Weekly update (October 14 ~ October 20, 2019)
      • Weekly update (September 30 ~ October 13, 2019)
    • 2019-09(5)
      • Weekly update (September 23 ~ September 29, 2019)
      • Weekly update (September 16 ~ September 22, 2019)
      • Weekly update (September 09 ~ September 15, 2019)
      • Weekly update (September 02 ~ September 08, 2019)
      • Weekly update (August 26 ~ September 01, 2019)
    • 2019-08(4)
      • Weekly update (August 19 ~ August 25, 2019)
      • Weekly update (August 12 ~ August 18, 2019)
      • Weekly update (August 05 ~ August 11, 2019)
      • Weekly update (July 29 ~ August 04, 2019)
    • 2019-07(5)
      • Weekly update (July 22 ~ July 28, 2019)
      • Weekly update (July 15 ~ July 21, 2019)
      • Weekly update (July 08 ~ July 14, 2019)
      • Weekly update (July 01 ~ July 07, 2019)
      • Weekly update (June 24 ~ June 30, 2019)
    • 2019-06(4)
      • Weekly update (June 17 ~ June 23, 2019)
      • Weekly update (June 10 ~ June 16, 2019)
      • Weekly update (June 03 ~ June 09, 2019)
      • Weekly update (May 27 ~ June 02, 2019)
    • 2019-05(4)
      • Weekly update (May 20 ~ May 26, 2019)
      • Weekly update (May 13 ~ May 19, 2019)
      • Weekly update (May 06 ~ May 12, 2019)
      • Weekly update (April 29 ~ May 05, 2019)
    • 2019-04(5)
      • Weekly update (April 22 ~ April 28, 2019)
      • Weekly update (April 15 ~ April 21, 2019)
      • Weekly update (April 08 ~ April 14, 2019)
      • Weekly update (April 01 ~ April 07, 2019)
      • Weekly update (March 25 ~ March 31, 2019)
    • 2019-03(4)
      • Weekly update (March 18 ~ March 24, 2019)
      • Weekly update (March 11 ~ March 17, 2019)
      • Weekly update (March 04 ~ March 10, 2019)
      • Weekly update (February 25 ~ March 03, 2019)
    • 2019-02(3)
      • Weekly update (February 18 ~ February 24, 2019)
      • Weekly update (February 11 ~ February 17, 2019)
      • Weekly update (January 28 ~ February 10, 2019)
    • 2019-01(5)
      • Weekly update (January 21 ~ January 27, 2019)
      • Weekly update (January 14 ~ January 20, 2019)
      • Weekly update (January 07 ~ January 13, 2019)
      • Weekly update (December 31 ~ January 06, 2019)
      • Weekly update (December 24 ~ December 30, 2018)
  • 2018(49)
    • 2018-12(4)
      • Weekly update (December 17 ~ December 23, 2018)
      • Weekly update (December 10 ~ December 16, 2018)
      • Weekly update (December 03 ~ December 09, 2018)
      • Weekly update (November 26 ~ December 02, 2018)
    • 2018-11(4)
      • Weekly update (November 19 ~ November 25, 2018)
      • Weekly update (November 12 ~ November 18, 2018)
      • Weekly update (November 05 ~ November 11, 2018)
      • Weekly update (October 29 ~ November 04, 2018)
    • 2018-10(3)
      • Weekly update (October 22 ~ October 28, 2018)
      • Weekly update (October 15 ~ October 21, 2018)
      • Weekly update (September 24 ~ October 14, 2018)
    • 2018-09(4)
      • Weekly update (September 17 ~ September 23, 2018)
      • Weekly update (September 10 ~ September 16, 2018)
      • Weekly update (September 03 ~ September 09, 2018)
      • Weekly update (August 27 ~ September 02, 2018)
    • 2018-08(4)
      • Weekly update (August 20 ~ August 26, 2018)
      • Weekly update (August 13 ~ August 19, 2018)
      • Weekly update (August 06 ~ August 12, 2018)
      • Weekly update (July 30 ~ August 05, 2018)
    • 2018-07(5)
      • Weekly update (July 23 ~ July 29, 2018)
      • Weekly update (July 16 ~ July 22, 2018)
      • Weekly update (July 09 ~ July 15, 2018)
      • Weekly update (July 02 ~ July 08, 2018)
      • Weekly update (June 25 ~ July 01, 2018)
    • 2018-06(4)
      • Weekly update (June 18 ~ June 24, 2018)
      • Weekly update (June 11 ~ June 17, 2018)
      • Weekly update (June 04 ~ June 10, 2018)
      • Weekly update (May 28 ~ June 03, 2018)
    • 2018-05(5)
      • Weekly update (May 21 ~ May 27, 2018)
      • Weekly update (May 14 ~ May 20, 2018)
      • Weekly update (May 07 ~ May 13, 2018)
      • Weekly update (April 30 ~ May 06, 2018)
      • Weekly update (April 23 ~ April 29, 2018)
    • 2018-04(4)
      • Weekly update (April 16 ~ April 22, 2018)
      • Weekly update (April 09 ~ April 15, 2018)
      • Weekly update (April 02 ~ April 08, 2018)
      • Weekly update (March 26 ~ April 01, 2018)
    • 2018-03(4)
      • Weekly update (March 19 ~ March 25, 2018)
      • Weekly update (March 12 ~ March 18, 2018)
      • Weekly update (March 05 ~ March 11, 2018)
      • Weekly update (February 26 ~ March 04, 2018)
    • 2018-02(3)
      • Weekly update (February 12 ~ February 25, 2018)
      • Weekly update (February 05 ~ February 11, 2018)
      • Weekly update (January 29 ~ February 04, 2018)
    • 2018-01(5)
      • Weekly update (January 22 ~ January 28, 2018)
      • Weekly update (January 15 ~ January 21, 2018)
      • Weekly update (January 08 ~ January 14, 2018)
      • Weekly update (January 01 ~ January 07, 2018)
      • Weekly update (December 25 ~ December 31, 2017)
  • 2017(43)
    • 2017-12(4)
      • Weekly update (December 18 ~ December 24, 2017)
      • Weekly update (December 11 ~ December 17, 2017)
      • Weekly update (December 04 ~ December 10, 2017)
      • Weekly update (November 27 ~ December 03, 2017)
    • 2017-11(4)
      • Weekly update (November 20 ~ November 26, 2017)
      • Weekly update (November 13 ~ November 19, 2017)
      • Weekly update (November 06 ~ November 12, 2017)
      • Weekly update (October 30 ~ November 05, 2017)
    • 2017-10(3)
      • Weekly update (October 23 ~ October 29, 2017)
      • Weekly update (October 9 ~ October 22, 2017)
      • Weekly update (September 25 ~ October 08, 2017)
    • 2017-09(4)
      • Weekly update (September 18 ~ September 24, 2017)
      • Weekly update (September 11 ~ September 17, 2017)
      • Weekly update (September 04 ~ September 10, 2017)
      • Weekly update (August 28 ~ September 03, 2017)
    • 2017-08(4)
      • Weekly update (August 21 ~ August 27, 2017)
      • Weekly update (August 14 ~ August 20, 2017)
      • Weekly update (August 07 ~ August 13, 2017)
      • Weekly update (July 31 ~ August 06, 2017)
    • 2017-07(4)
      • Weekly update (July 24 ~ July 30, 2017)
      • Weekly update (July 17 ~ July 23, 2017)
      • Weekly update (July 10 ~ July 16, 2017)
      • Weekly update (June 26 ~ July 02, 2017)
    • 2017-06(4)
      • Weekly update (June 19 ~ June 25, 2017)
      • Weekly update (June 12 ~ June 18, 2017)
      • Weekly update (June 06 ~ June 11, 2017)
      • Weekly update (May 22 ~ June 05, 2017)
    • 2017-05(4)
      • Weekly update (May 15 ~ May 21, 2017)
      • Weekly update (May 08 ~ May 14, 2017)
      • Weekly update (May 01 ~ May 07, 2017)
      • Weekly update (April 24 ~ April 30, 2017)
    • 2017-04(2)
      • Weekly update (April 10 ~ April 16, 2017)
      • Weekly update (March 27 ~ April 09, 2017)
    • 2017-03(4)
      • Weekly update (March 20 ~ March 26, 2017)
      • Weekly update (March 13 ~ March 19, 2017)
      • Weekly update (March 06 ~ March 12, 2017)
      • Weekly update (February 27 ~ March 05, 2017)
    • 2017-02(3)
      • Weekly update (February 19 ~ February 26, 2017)
      • Weekly update (February 06 ~ February 12, 2017)
      • Weekly update (January 23 ~ February 05, 2017)
    • 2017-01(3)
      • Weekly update (January 09 ~ January 22, 2017)
      • Weekly update (January 02 ~ January 08, 2017)
      • Weekly update (December 26 ~ January 01, 2017)
  • 2016(22)
    • 2016-12(4)
      • Weekly update (December 19 ~ December 25, 2016)
      • Weekly update (December 12 ~ December 18, 2016)
      • Weekly update (December 05 ~ December 11, 2016)
      • Weekly update (November 28 ~ December 04, 2016)
    • 2016-11(4)
      • Weekly update (November 21 ~ November 27, 2016)
      • Weekly update (November 14 ~ November 20, 2016)
      • Weekly update (November 07 ~ November 13, 2016)
      • Weekly update (October 31 ~ November 06, 2016)
    • 2016-10(3)
      • Weekly update (October 24 ~ October 30, 2016)
      • Weekly update (October 17 ~ October 23, 2016)
      • Weekly update (October 01 ~ October 16, 2016)
    • 2016-09(5)
      • Weekly update (September 26 ~ September 30, 2016)
      • Weekly update (September 19 ~ September 25, 2016)
      • Weekly update (September 12 ~ September 18, 2016)
      • Weekly update (September 05 ~ September 11, 2016)
      • Weekly update (August 29 ~ September 04, 2016)
    • 2016-08(4)
      • Weekly update (August 22 ~ August 28, 2016)
      • Weekly update (August 13 ~ August 21, 2016)
      • Weekly update (August 05 ~ August 12, 2016)
      • Weekly update (July 30 ~ August 05, 2016)
    • 2016-07(2)
      • Weekly update (July 23 ~ July 29, 2016)
      • Weekly update (July 17 ~ July 22, 2016)
  • Date iconMon, Nov 25, 2019

TiDB Weekly

News & blog posts

In recent years, building a large-scale distributed storage system has become a hot topic. Distributed consensus algorithms like Paxos and Raft are the focus of many technical articles. Last week, we published a post to share some of our firsthand experience in designing a large-scale distributed storage system based on the Raft consensus algorithm.

The full article is here:

Building a Large-scale Distributed Storage System Based on Raft

Community

New contributors

tidb:

  • AerysNan
  • Lanearth
  • YourLovely
  • zouhuan1215
  • SilvaXiang
  • catror
  • someblue
  • koushiro
  • Baytwt
  • silver–bullet

tikv:

  • MaiCw4J
  • AerysNan
  • TommyCpp
  • Renkai
  • wangwangwar

pd:

  • qinggniq
  • hrbeuyz24

docs-cn:

  • baiyuqing

Call for participation

  • Vectorized Expression Working Group

    • Date or Time built-in functions (30⁄65)
    • Decimal built-in functions (20⁄31)
    • Int built-in functions (155⁄187)
    • JSON built-in functions (22⁄27)
    • Real built-in functions (46⁄49)
    • String built-in functions (89⁄133)
    • Duration built-in functions (17⁄45)
    • Last week, 43 PRs were landed in the expression component.

  • Coprocessor SIG:

    • Improve the performance of Chunk Encoder
    • Implement more UDFs
    • Implement the new row format
    • Port BinaryJSON
    • Tracing
    • The maximum execution time of Per-request

  • More issues to solve for TiDB

  • More issues to solve for TiKV

Updates of the week

Progress

Last week, we landed 145 PRs in the TiDB repository, 4 PRs in the TiSpark repository, and 76 PRs in the TiKV and PD repositories.

Critical PRs

TiDB:

  • Enable the push-down of 19 functions
  • Do not set the statement priority when tidb_force_priority is set
  • Allocate continuous RowID for the single INSERT statement
  • Support the SQL bindings management
  • Make the error message more readable when dropping the primary key
  • Fix the bug that the cached store cannot be updated when the store address is changed and the original address is made offline
  • Implement the non-block read when Coprocessor meets the lock of a large transaction

TiSpark:

  • Fix TiKV DAGRequest’s outputOffsets

TiKV and PD:

  • Update the blob file format for the ZSTD dictionary compression
  • Replace crc by crc32fast and crc64fast
  • Reduce the size of tikv::storage::errors::Error
  • Update RocksDB and Titan
  • Return commit_ts in the commit response
  • Fix the maximum receivable message size for the client
  • Delay the Replica read when applying a snapshot
  • Add more engine abstraction that works towards Peekable and Iterable for the snapshot
  • Add the rollback reason for check_txn_status
  • Encapsulate IOLimiter and remove the RocksDB dependency from sst_importer

Upcoming TiDB events

Apache Pulsar Meetup x PingCAP Infra Meetup

Date: November 30th, 2019

Location: PingCAP office in Beijing

Product

  • TiDB
  • TiSpark
  • Roadmap

Docs

  • Quick Start
  • Best Practices
  • FAQ
  • TiDB Tools
  • Release Notes

Resources

  • Blog
  • Weekly
  • GitHub
  • TiDB Community

Company

  • About
  • Careers
  • News
  • Contact Us
  • Privacy Policy
  • Terms of Service

Connect

  • Twitter
  • LinkedIn
  • Reddit
  • Google Group
  • Stack Overflow

© 2019 PingCAP. All Rights Reserved.

中文