Skip to content

Start-Up Ideas, Tech Code, Use Cases, Thoughts

Home
About
Blog
Scala – Code Snippets
Spark – Code Snippets
Kafka
NoSQL – Cassandra/HBase
Elastic Search
Machine Learning
AWS – Blog
Scala Concepts-Code

HomePosts tagged 'Spark'

Spark

Spark – 2.0- queries support

November 6, 2016November 15, 2016 corerootz - Ravi Kiran Krovvidi Spark Spark

notebook –

https://databricks-prod-cloudfront.cloud.databricks.com/public/4027ec902e239c93eaaa8714f173bcfc/3899191213787965/1272577636928442/4470307539133987/latest.html

Leave a comment

spark – transformation – set theory/ relational

November 6, 2016 corerootz - Ravi Kiran Krovvidi Spark Spark

• union

• intersection

• subtract

• distinct

• cartesian

• zip

Leave a comment

spark – Transformation – Math/ Statistical

November 6, 2016November 7, 2016 corerootz - Ravi Kiran Krovvidi Spark Spark

> sample

> randomSplit

Leave a comment

Spark – General Transformations

November 6, 2016November 6, 2016 corerootz - Ravi Kiran Krovvidi Spark Spark

• map

• filter

• flatMap

• mapPartitions

• mapPartitionsWithIndex

• groupBy

• sortBy

Leave a comment

Learning Topics

Amazon Amazon kinesis Audio Engineering - Emotion recognition - Open Emotion Affect Recognition cassandra Graph databases Kafka NoSQL - Cassandra, HBase Scala Spark Uncategorized Unix/ Linux

Recent

SPARK – streaming
spark – partition
spark – performance
spark – actions
spark – transformations

Tags

Amazon kinesis amazon kinesis producer library cassandra-atomicity-isolation-rowlevel cassandra - blob cassandra - collection cassandra - frozen in collection cassandra - managing data cassandra - Murmur3Partitioner cassandra- single datacenter cluster cassandra - TimeToLive - TTL cassandra - yaml - seed provider cassandra architecture cassandra column type cassandra configuration-key components cassandra consistent hashing cassandra counter type cassandra create table cassandra data model cassandra fn - writetime cassandra generating tokens cassandra GossipingPropertyFileSnitch cassandra keyspace cassandra key structures cassandra partition key cassandra primary key cassandra starting seed nodes first cassandra static column cassandra table properties cassandra writes cassandra yaml Scala scala-function-argument less scala - pattern variable scala - typed pattern scala append to list scala better language scala case classes scala class object scala constant pattern scala constructor pattern scala curry scala erasure exception - arrays scala format string scala identifier scala immutability scala isinstanceof asinstanceof scala lang advantage scala literals scala Map scala null scala Option Type scala pattern guard scala procedure scala questions scala recursion tail scala sealed class scala sequence pattern scala Set scala symbol scala trait scala tuple pattern scala tuples scala type erasure scala variable binding pattern scala variable pattern scala variables vals scala when use trait scala wildcard pattern Spark spark architecture spark configuration location spark job debug spark json spark parquet Unix/Linux

Search for:

Pages

About
Blog
Contact
Datascience – Info
Scala Concepts-Code
- Technology Consciousness – Solving World Problems
Spark – org.apache.spark.sql.SparkSession

Blog at WordPress.com.

Subscribe Subscribed
- Start-Up Ideas, Tech Code, Use Cases, Thoughts
- Already have a WordPress.com account? Log in now.