# spark

2 min read

Damon P. Cortesi

Jul 9

Build your own Air Quality Map with OpenAQ and EMR on EKS

#aws #kubernetes #spark #emr

12 min read

Ivan G

Jun 29

Getting Info About Spark Partitions

#spark #databricks #python

3 min read

Pawan Kumar

Jul 6

Spark : Replace collect()[][]

#spark

4 1

1 min read

Marco Villarreal

Jun 27

Creating a Spark Standalone Cluster with Docker and docker-compose(2021 update)

#docker #spark #bigdata

7 min read

javinpaul

Jun 19

5 Best Big Data Frameworks You Can Learn in 2021

#java #bigdata #spark #programming

48

8 min read

Karun Japhet

May 9

Data storage patterns, versioning and partitions

#datascience #bigdata #spark #s3

9 min read

Pascal Gillet for Stack Labs

Apr 12

My Journey With Spark On Kubernetes... In Python (1/3)

#spark #kubernetes #python

20

9 min read

Pascal Gillet for Stack Labs

Apr 12

My Journey With Spark On Kubernetes... In Python (2/3)

#spark #kubernetes #python

12

9 min read

Pascal Gillet for Stack Labs

Apr 12

My Journey With Spark On Kubernetes... In Python (3/3)

#spark #kubernetes #python

11

17 min read

Darren Fuller

Mar 28

Unit testing your PySpark library

#python #spark #testing #pyspark

9 min read

Kevin Wallimann

Mar 11

How to recover from a deleted _spark_metadata folder in Spark Structured Streaming

#spark

7 2

5 min read

JY @ DataMechanics

Nov 23 '20

Spark and Docker: Your Spark development cycle just got 10x faster !

#spark #docker #kubernetes #devops

15

7 min read

JY @ DataMechanics

Nov 20 '20

How-to guide: Set up, Manage & Monitor Spark on Kubernetes

#spark #kubernetes #docker #cloudnative

20

10 min read

hellocodeclub

Nov 9 '20

Apache Spark Java Tutorial: Simplest Guide to Get Started

#machinelearning #spark #java #bigdata

3 min read

Kevin Wallimann

Nov 6 '20

Is Structured Streaming Exactly-Once? Well, it depends...

#spark

4 min read

Sachin Gupta

Oct 2 '20

can a map function be executed on multiple executors for an item in RDD.

#spark

1 min read

Musa Atlıhan

Oct 26 '20

Predicting machine failures with distributed computing (Spark, AWS EMR, and DL)

#spark #emr #bigdata #deeplearning

10 min read

Ken Tune for Aerospike

Oct 21 '20

Using Aerospike Connect For Spark

#aerospike #spark

5 min read

Ayoub Fakir

Oct 16 '20

Migrating from a plain Spark Application to ZIO with ZparkIO

#scala #spark #zio #functional

6 min read

Gustavo Martin Morcuende for Adevinta Spain

Oct 15 '20

Spark: unit, integration and end-to-end tests.

#scala #spark #testing

13

5 min read

Dust on Mint

Aug 29 '20

Spark Side Menu Micro-Interactions Deconstruction

#microinteraction #email #spark #frontend

2 min read

Moshe Roth

Sep 28 '20

Spark Journey begins...

#spark #python #bigdata

3 min read

Saša Zejnilović

Sep 20 '20

Working with nested structures in Spark

#spark #bigdata #scala #library

6 1

3 min read

Manikantha Nekkalapudi

Sep 14 '20

Intoduction to Apache Spark

#dataengineering #apachespark #bigdata #spark

6 min read

Samuele Resca

Sep 2 '20

Large-Scale Data Quality Verification in .NET PT.1

#dotnet #spark #dotnetcore #dataengineering

9 min read

Bartosz Gajda

Aug 10 '20

Unit Testing Apache Spark Structured Streaming using MemoryStream

#spark #apachespark #testing #bigdata

4 min read

Bartosz Gajda

Aug 10 '20

Setting up IntelliJ IDEA for Apache Spark and Scala development

#spark #scala #intellij #tutorial

2 min read

Bartosz Gajda

Aug 10 '20

Exploiting Schema Inference in Apache Spark

#spark #scala #bigdata #datascience

3 min read

Kevin Wallimann

Jul 11 '20

How to make a column non-nullable in Spark Structured Streaming

#spark

2 min read

Avantika Shergil

Jul 10 '20

Hadoop vs Spark: Which is a better framework to select for processing Big Data?

#bigdataframework #hadoop #spark #bigdata

5 min read

Shad Amez

Jul 10 '20

Why are we building DevOps platform for Big Data?

#spark #devops #bigdata #motivation

3 min read

Joy Uchenna

Jun 30 '20

The Big Data Bravura: Introducing Apache Spark

#bigdata #spark #pyspark #datascience

20 2

3 min read

Kévin

Jun 21 '20

Install Apache Spark (and Apache Hadoop) smoothly

#opensource #bash #spark #scala

1 min read

Hugo Estrada S.

Jun 4 '20

Apache Spark and Databricks 101 pt. II - Some DataFrames

#databricks #spark #datascience

1 min read

Kovid Rathee

Jun 2 '20

When To Cache?

#datascience #python #pyspark #spark

2 min read

Hugo Estrada S.

Jun 1 '20

Apache Spark and Databricks 101 pt. I - The Big Picture

#databricks #spark #datascience

2 min read

Akalanka Weerasooriya

May 28 '20

Building a Spark cluster with two PCs and a Raspberry Pi.

#spark #hadoop #bigdata #raspberrypi

5 min read

Shaine Ismail

May 15 '20

Calling a stored Procedure SQL Server stored procedure from Spark

#scala #spark #datascience

1 min read

Cecil L. Phillip 🇦🇬 for .NET

May 12 '20

On.NET Episode: Data processing with .NET for Apache Spark

#dotnet #spark #bigdata #azure

1 min read

Shekhar Sahu

May 4 '20

Migrate From Hadoop To Apache Spark

#Hadoop #Apache #Spark #BigData

1 min read

Ben Steadman

May 3 '20

Python, Spark and the JVM: An overview of the PySpark Runtime Architecture

#python #spark #pyspark #architecture

16

4 min read

Saša Zejnilović

May 1 '20

How to compare your data in/with Spark

#spark #scala #testing #bigdata

6 min read

Ryan

Feb 27 '20

Writing Spark: Scala Vs Java

#spark #scala #java

9 2

7 min read

luminousmen

Jan 14 '20

The 5-minute guide to using bucketing in Pyspark

#spark #python #bigdata

9 4

4 min read

Shad Amez

Jan 12 '20

spark-submit command builder with live preview

#spark #bigdata #productivity #scala

1 min read

Sameh Sharaf

Jan 9 '20

Databricks Delta Lake - A Friendly Intro

#databricks #delta #datalake #spark

12 1

1 min read

anilkulkarni87

Jan 4 '20

How to view Spark History logs locally

#logs #spark #sparkhistory #tutorial

1 min read

Jakub T

Jan 1 '20

How to run pyspark with additional Spark packages

#spark #python #pyspark #delta

2 min read

Francisco Ruiz A

Dec 31 '19

My Databricks article compilation of 2019

#databricks #delta #spark #bigdata

2 min read

Andrew (he/him)

Dec 13 '19

Installing and Running Hadoop and Spark on Ubuntu 18

#hadoop #spark #java #scala

27 6

10 min read

Subash Sivaji

Nov 27 '19

Types of Apache Spark tables and views

#spark #databricks

2 min read

Igor Bertnyk

Oct 29 '19

Yet another journey to Cloudera Spark and Hadoop Developer Certification - CCA 175

#spark #cloudera #certification #cca175

6 min read

Michel's fanboi

Oct 12 '19

Path to become a junior+ data engineer?

#help #distributedsystems #spark #hadoop

6 1

1 min read

lukaszkuczynski

Oct 6 '19

Spark is Pandas on steroids

#pandas #spark #databricks

5 min read

Samuele Resca

Sep 30 '19

Getting started with Apache Spark using .NET Core

#dotnet #machinelearning #spark #dotnetcore

12 1

7 min read

Saloni Goyal

Sep 25 '19

Introduction to Apache Spark

#spark #hadoop #beginners #mapreduce

3 min read

luminousmen

Sep 22 '19

Azure Blob Storage with Pyspark

#python #spark #bigdata #azure

10 1

2 min read

Sumit Kumar

Sep 21 '19

Why we chose Apache Spark for ETL (Extract-Transform-Load)

#spark #dataengineering #pyspark #whywechose

23

6 min read

AsifYar

Aug 31 '19

Divide RDD into sub parts

#scala #spark