Saturday, January 23, 2021
  • Setup menu at Appearance » Menus and assign menu to Top Bar Navigation
Advertisement
  • AI Development
    • Artificial Intelligence
    • Machine Learning
    • Neural Networks
    • Learn to Code
  • Data
    • Blockchain
    • Big Data
    • Data Science
  • IT Security
    • Internet Privacy
    • Internet Security
  • Marketing
    • Digital Marketing
    • Marketing Technology
  • Technology Companies
  • Crypto News
No Result
View All Result
NikolaNews
  • AI Development
    • Artificial Intelligence
    • Machine Learning
    • Neural Networks
    • Learn to Code
  • Data
    • Blockchain
    • Big Data
    • Data Science
  • IT Security
    • Internet Privacy
    • Internet Security
  • Marketing
    • Digital Marketing
    • Marketing Technology
  • Technology Companies
  • Crypto News
No Result
View All Result
NikolaNews
No Result
View All Result
Home Technology Companies

Kafka Monthly Digest – December 2020 and 2020 in review – IBM Developer

January 14, 2021
in Technology Companies
Six courses to build your technology skills in 2021 – IBM Developer
585
SHARES
3.3k
VIEWS
Share on FacebookShare on Twitter

Credit: IBM

You might also like

The Eclipse Foundation’s move to Europe will bring open standards and open source together – IBM Developer

Learn new skills while working on volunteer projects – IBM Developer

IBM Advance Toolchain for Linux on Power 13.0-3 released!

In this 35th edition of the Kafka Monthly Digest, I’ll cover what happened in the Apache Kafka community in December 2020 as well as some of the milestones that the project and community reached in 2020.

For last month’s digest, see Kafka Monthly Digest: November 2020.

Releases

2.7.0 Release

After seven release candidates, Bill Bejeck released Apache Kafka 2.7.0 on December 21. A post was published on the Apache blog, and as always you can find the full list of changes in the release notes or in the release plan on the wiki. This new minor version brings a number of interesting features.

Brokers/clients

  • PEM files can now be used to configured TLS certificates and private keys. (KIP-615)
  • Quotas can be applied on topic operations such as create, delete and alter. (KIP-599)
  • Quotas can be applied to the connection rate on brokers. (KIP-612)
  • Progress on the migration off ZooKeeper (KIP-500):
    • A Raft Protocol for building a metadata quorum has been created. (KIP-595)
    • Altering in-sync replicas and updating SCRAM configurations now only requires the controller to write to ZooKeeper. (KIP-497, KIP-554)

Connect

  • A new ConfigProvider, DirectoryConfigProvider, can be used to retrieve secrets in Kubernetes environments. (KIP-632)
  • Consumer offsets can now be automatically synchronized across clusters with MirrorMaker 2. (KIP-545)

Streams

  • New metrics to track end to end latency and RockDB status. (KIP-613, KIP-607)
  • Added support for sliding windows in the DSL. (KIP-450)
  • State stores can now be iterated backwards. (KIP-617)

2.6.1 Release

I released 2.6.1 on January 11. This bug fix version contains 41 fixes and improvements including 5 blocker JIRAs. You can check the release notes and the release plan for the full details.

KIPs

Last month, the community submitted 11 KIPs (KIP-689 to KIP-701), and these are the ones that caught my eye.

  • KIP-690: Add additional configuration to control MirrorMaker 2 internal topics naming convention. MirrorMaker 2 uses a few internal topics for its operations but at the moment their names can’t be customized. This KIP proposes introducing an interface, InternalTopicPolicy, that would allow administrators to configure the names of these internal topics. This is interesting in environments with strict naming policies or when isolating multiple MirrorMaker 2 instances is required.

  • KIP-694: Support Reducing Partitions for Topics. While Kafka supports adding partitions to topics, it is currently not possible to remove partitions. This KIP proposes a new protocol message, DeletePartitions, to support this new feature. For simplicity, it assumes topics have short retention periods and it does not handle transparently topics with keyed messages.

  • KIP-700: Add Describe Cluster API. Kafka has APIs to retrieve many details about clusters. Internally, most of this data has been added to the Metadata protocol message. However Metadata is designed for producers and consumers to periodically refresh their metadata so it’s not desirable to keep adding fields into this message. For that reason, this KIP introduces a new protocol message, DescribeCluster, to contain all cluster details. Fields not relevant for producers and consumers will also be deprecated and removed from Metadata.

In this section, I will cover releases of some community projects. This only includes projects that are Open Source.

  • node-rdkafka 2.10.0. This new release of node-rdkafka is now based on librdkafka 1.5.2. It also added support for librdkafka’s EOF events to identify when consumers reach the last offset of partitions.

Blogs

Milestones that the project and community achieved in 2020

Releases in 2020

The project followed its time-based release plan. Consequently, it released three major versions: 2.5.0, 2.6.0 and 2.7.0.

In addition, two bugfixes were also released: 2.4.1, 2.5.1.

KIPs in 2020

In the past 12 months, the community raised 142 KIPs. This is in line with previous years.

KIPs in 2020

Code and contributors

Over 200 unique contributors made more than 1400 commits in 2020.

Lines of code in 2020

These stats were generated using this command:

    git diff --shortstat $(git hash-object -t tree /dev/null)

Committers and PMC

In 2020, six contributors were invited to become Committers:

  • Konstantine Karantasis
  • Boyang Chen
  • Xi Hu
  • David Jacot
  • Chia-Ping Tsai
  • Sophie Blee-Goldman

Likewise, five Committers also joined the Apache Kafka PMC:

  • Colin McCabe
  • Vahid Hashemian
  • Manikumar Reddy
  • Mickael Maison (I still cannot quite believe that I’ve joined the PMC but that happened!)
  • John Roesler

Get started with Kafka

IBM Event Streams for Cloud is Apache Kafka-as-a-Service for IBM Cloud. Get started with IBM Event Streams today.

Credit: IBM

Previous Post

Microsoft mocks Facebook and it doesn't go down well

Next Post

The story of machine proofs — Part II | by Sharad Sundararajan | Jan, 2021

Related Posts

Istio 1.8 focuses on usability and upgrades – IBM Developer
Technology Companies

The Eclipse Foundation’s move to Europe will bring open standards and open source together – IBM Developer

January 15, 2021
Six courses to build your technology skills in 2021 – IBM Developer
Technology Companies

Learn new skills while working on volunteer projects – IBM Developer

January 8, 2021
Six courses to build your technology skills in 2021 – IBM Developer
Technology Companies

IBM Advance Toolchain for Linux on Power 13.0-3 released!

January 6, 2021
Six courses to build your technology skills in 2021 – IBM Developer
Technology Companies

Following the data science methodology – IBM Developer

January 6, 2021
Kubeflow Pipelines meets Tekton and Watson – IBM Developer
Technology Companies

New Node.js triage role is a great way to start contributing to Node.js – IBM Developer

January 5, 2021
Next Post
The story of machine proofs — Part II | by Sharad Sundararajan | Jan, 2021

The story of machine proofs — Part II | by Sharad Sundararajan | Jan, 2021

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Recommended

Plasticity in Deep Learning: Dynamic Adaptations for AI Self-Driving Cars

Plasticity in Deep Learning: Dynamic Adaptations for AI Self-Driving Cars

January 6, 2019
Microsoft, Google Use Artificial Intelligence to Fight Hackers

Microsoft, Google Use Artificial Intelligence to Fight Hackers

January 6, 2019

Categories

  • Artificial Intelligence
  • Big Data
  • Blockchain
  • Crypto News
  • Data Science
  • Digital Marketing
  • Internet Privacy
  • Internet Security
  • Learn to Code
  • Machine Learning
  • Marketing Technology
  • Neural Networks
  • Technology Companies

Don't miss it

Cisco warns on critical security vulnerabilities in SD-WAN software, so update now
Internet Security

Cisco warns on critical security vulnerabilities in SD-WAN software, so update now

January 23, 2021
Global Machine Learning as a Service Market (2020-2026) | Latest COVID19 Impact Analysis | Know About Brand Players: Amazon, Oracle, IBM, Microsoftn, Google, etc.
Machine Learning

Machine Learning Courses Market 2020: Potential growth, attractive valuation make it is a long-term investment | Know the COVID19 Impact | Top Players: EdX, Ivy Professional School, NobleProg, Udacity, Edvancer, etc.

January 23, 2021
New website launched to document vulnerabilities in malware strains
Internet Security

New website launched to document vulnerabilities in malware strains

January 23, 2021
Splunk : Get to Know Splunk Machine Learning Environment (SMLE)
Machine Learning

Splunk : Get to Know Splunk Machine Learning Environment (SMLE)

January 23, 2021
License Plate Recognition (All you need to know) (ANPR) Part1 | by Sameer Bairwa
Neural Networks

License Plate Recognition (All you need to know) (ANPR) Part1 | by Sameer Bairwa

January 23, 2021
FSB warns of US cyberattacks after Biden administration comments
Internet Security

FSB warns of US cyberattacks after Biden administration comments

January 23, 2021
NikolaNews

NikolaNews.com is an online News Portal which aims to share news about blockchain, AI, Big Data, and Data Privacy and more!

What’s New Here?

  • Cisco warns on critical security vulnerabilities in SD-WAN software, so update now January 23, 2021
  • Machine Learning Courses Market 2020: Potential growth, attractive valuation make it is a long-term investment | Know the COVID19 Impact | Top Players: EdX, Ivy Professional School, NobleProg, Udacity, Edvancer, etc. January 23, 2021
  • New website launched to document vulnerabilities in malware strains January 23, 2021
  • Splunk : Get to Know Splunk Machine Learning Environment (SMLE) January 23, 2021

Subscribe to get more!

© 2019 NikolaNews.com - Global Tech Updates

No Result
View All Result
  • AI Development
    • Artificial Intelligence
    • Machine Learning
    • Neural Networks
    • Learn to Code
  • Data
    • Blockchain
    • Big Data
    • Data Science
  • IT Security
    • Internet Privacy
    • Internet Security
  • Marketing
    • Digital Marketing
    • Marketing Technology
  • Technology Companies
  • Crypto News

© 2019 NikolaNews.com - Global Tech Updates