Open in app

Sign In

Write

Sign In

Prateek
Prateek

204 Followers

Home

Lists

About

Jun 23

DSL, stateful transformations, reduce()

Demonstrates how to use `reduce` to sum numbers Create Topics kafka-topics --create --topic numbers-topic --bootstrap-server localhost:9092 --partitions 1 --replication-factor 1 kafka-topics --create --topic sum-of-odd-numbers-topic --bootstrap-server localhost:9092 --partitions 1 --replication-factor 1 Start Consumer kafka-console-consumer --topic sum-of-odd-numbers-topic --from-beginning --bootstrap-server localhost:9092 --property value.deserializer=org.apache.kafka.common.serialization.IntegerDeserializer…

Kafka Streams

3 min read

DSL, stateful transformations, reduce()
DSL, stateful transformations, reduce()
Kafka Streams

3 min read


Jun 22

Avro Example 6 — UUID

If you want to learn the usage of UUID in avsc file, lets checkout the below — address.avsc { "name":"Address", "namespace": "com.example.generated.model", "type": "record", "fields": [ {"name":"addressLine1","type": "string"}, {"name":"city","type": "string"}, { "name":"state_province","type": "string"}, {"name":"country","type": "string","default": "USA"}, { "name":"zip","type": "string"} ] }

Avro

2 min read

Avro

2 min read


Jun 22

Avro Example 5 -use Date and Timestamp

How to use Date and Timestamp in Avro, lets check that out — address.avsc { "name":"Address", "namespace": "com.example.generated.model", …

Avro

3 min read

Avro

3 min read


Jun 22

Avro Example 4 — Use Array

How to use Array in Avro schema, lets check this out — address.avsc { "name":"Address", "namespace": "com.example.generated.model", …

Avro

3 min read

Avro

3 min read


Jun 22

Avro Example 3 — Use Enum

In this example, we’ll use Enum and see how we can work with it. customer.avsc { "type": "record", "namespace": "com.example.generated.model", "name": "Customer", "fields": [ { "name": "first_name", "type"…

Avro

2 min read

Avro

2 min read


Jun 21

Avro Example 2 — best

Continuing what left here: https://medium.com/@prateek-ashtikar512/avro-example-1-503ccf88bfe1 Modified pom.xml speacifically plugins to read multiple avsc files pom.xml <project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd"> <modelVersion>4.0.0</modelVersion> <groupId>com.example</groupId> <artifactId>avro-demo-1</artifactId> <version>0.0.1-SNAPSHOT</version> <packaging>jar</packaging>…

Avro

2 min read

Avro

2 min read


Jun 21

Avro example 1

Apache Avro is a language-neutral data serialization system, developed by Doug Cutting, the father of Hadoop. This is a brief tutorial that provides an overview of how to set up Avro and how to serialize and deserialize data using Avro. Data is serialized for two objectives − For persistent storage …

Avro

3 min read

Avro

3 min read


Apr 10

ksqlDB Tutorial — Quickstart

I tried to create a detailed notes looking at the : https://www.youtube.com/watch?v=RPdyTEwn27w. Please use below setting to see all data from beginning. SET 'auto.offset.reset'='earliest'; Create ORDERS Topic and ORDERS Streams kafka-topics --create --bootstrap-server localhost:9092 --replication-factor 1 --partitions 1 --topic ORDERS ksql> CREATE STREAM ORDERS (order_id VARCHAR, product_name VARCHAR, number INT…

Ksqldb

4 min read

ksqlDB Tutorial — Quickstart
ksqlDB Tutorial — Quickstart
Ksqldb

4 min read


Apr 6

Java and KSQLDB — KTable demo

Create Topic kafka-topics --create --bootstrap-server localhost:9092 --replication-factor 1 --partitions 1 --topic COUNTRY-CSV Create Table ksql> CREATE TABLE COUNTRYTABLE (countrycode VARCHAR PRIMARY KEY, countryname VARCHAR) WITH (KAFKA_TOPIC='COUNTRY-CSV', VALUE_FORMAT='DELIMITED'); Message --------------- Table created --------------- ksql> show tables; Table Name | Kafka Topic | Key…

Ksql

2 min read

Java and KSQLDB — KTable demo
Java and KSQLDB — KTable demo
Ksql

2 min read


Apr 6

Java & KSQLDB — apply scalar functions

I’ll further enhance this to use scenario from here: https://prateek-ashtikar512.medium.com/java-ksqldb-create-stream-with-json-7a22ccbecafa Link for reference — https://docs.ksqldb.io/en/latest/reference/#scalar-functions I hope you’ve already created USERPROFILE topic and users_stream streams kafka-topics --create --bootstrap-server localhost:9092 --replication-factor 1 --partitions 1 --topic USERPROFILE Created topic USERPROFILE.

Ksql

3 min read

Java & KSQLDB — apply scalar functions
Java & KSQLDB — apply scalar functions
Ksql

3 min read

Prateek

Prateek

204 Followers

Java Developer and enthusiast

Following
  • Simon Aubury

    Simon Aubury

  • Dick Dowdell

    Dick Dowdell

  • Timotius Pamungkas

    Timotius Pamungkas

  • Saif

    Saif

  • Kousik Nath

    Kousik Nath

See all (12)

Help

Status

Writers

Blog

Careers

Privacy

Terms

About

Text to speech

Teams