If you want to learn the usage of UUID in avsc file, lets checkout the below — address.avsc { "name":"Address", "namespace": "com.example.generated.model", "type": "record", "fields": [ {"name":"addressLine1","type": "string"}, {"name":"city","type": "string"}, { "name":"state_province","type": "string"}, {"name":"country","type": "string","default": "USA"}, { "name":"zip","type": "string"} ] }

How to use Date and Timestamp in Avro, lets check that out — address.avsc { "name":"Address", "namespace": "com.example.generated.model", …

How to use Array in Avro schema, lets check this out — address.avsc { "name":"Address", "namespace": "com.example.generated.model", …

In this example, we’ll use Enum and see how we can work with it. customer.avsc { "type": "record", "namespace": "com.example.generated.model", "name": "Customer", "fields": [ { "name": "first_name", "type"…

Continuing what left here: https://medium.com/@prateek-ashtikar512/avro-example-1-503ccf88bfe1 Modified pom.xml speacifically plugins to read multiple avsc files pom.xml <project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd"> <modelVersion>4.0.0</modelVersion> <groupId>com.example</groupId> <artifactId>avro-demo-1</artifactId> <version>0.0.1-SNAPSHOT</version> <packaging>jar</packaging>…

Apache Avro is a language-neutral data serialization system, developed by Doug Cutting, the father of Hadoop. This is a brief tutorial that provides an overview of how to set up Avro and how to serialize and deserialize data using Avro. Data is serialized for two objectives − For persistent storage …

I tried to create a detailed notes looking at the : https://www.youtube.com/watch?v=RPdyTEwn27w. Please use below setting to see all data from beginning. SET 'auto.offset.reset'='earliest'; Create ORDERS Topic and ORDERS Streams kafka-topics --create --bootstrap-server localhost:9092 --replication-factor 1 --partitions 1 --topic ORDERS ksql> CREATE STREAM ORDERS (order_id VARCHAR, product_name VARCHAR, number INT…

Create Topic kafka-topics --create --bootstrap-server localhost:9092 --replication-factor 1 --partitions 1 --topic COUNTRY-CSV Create Table ksql> CREATE TABLE COUNTRYTABLE (countrycode VARCHAR PRIMARY KEY, countryname VARCHAR) WITH (KAFKA_TOPIC='COUNTRY-CSV', VALUE_FORMAT='DELIMITED'); Message --------------- Table created --------------- ksql> show tables; Table Name | Kafka Topic | Key…

I’ll further enhance this to use scenario from here: https://prateek-ashtikar512.medium.com/java-ksqldb-create-stream-with-json-7a22ccbecafa Link for reference — https://docs.ksqldb.io/en/latest/reference/#scalar-functions I hope you’ve already created USERPROFILE topic and users_stream streams kafka-topics --create --bootstrap-server localhost:9092 --replication-factor 1 --partitions 1 --topic USERPROFILE Created topic USERPROFILE.