Skip to content

SQL & Hadoop

SQL on Hadoop with Hive, Spark & PySpark on EMR & AWS Glue

Home
About
Privacy Policy

SQL & Hadoop

SQL on Hadoop with Hive, Spark & PySpark on EMR & AWS Glue

About
AWS Glue
Blog
Free Online SQL to PySpark Converter
Generate Spark JDBC Connection String online
Home
Optimise Spark Configurations – Online Generator
Privacy Policy
PySpark Cheat Sheet
Apache Spark Tutorial

cropped-SH-512×512-1.png

Leave a Comment / By Raj / July 2, 2021

https://sqlandhadoop.com/wp-content/uploads/2021/07/cropped-SH-512×512-1.png

Post navigation

← Previous Media

Leave a ReplyCancel reply

Topics

Amazon EMR
Apache HIVE
Apache Spark
AWS Glue
PySpark
SQL on Hadoop

Recent Posts

AWS Glue create dynamic frame
AWS Glue read files from S3
How to check Spark run logs in EMR
PySpark apply function to column
Run Spark Job in existing EMR using AIRFLOW

Recent Posts

AWS Glue create dynamic frame
AWS Glue read files from S3
How to check Spark run logs in EMR
PySpark apply function to column
Run Spark Job in existing EMR using AIRFLOW

Join the discussion

Ramkumar on Spark Performance Tuning with help of Spark UIFebruary 3, 2025
Great. Keep writing more articles.
Raj on Free Online SQL to PySpark ConverterAugust 9, 2022
Thank you for sharing this. I will give it a try as well.
John K-W on Free Online SQL to PySpark ConverterAugust 8, 2022
Might be interesting to add a PySpark dialect to SQLglot https://github.com/tobymao/sqlglot https://github.com/tobymao/sqlglot/tree/main/sqlglot/dialects
Meena M on Spark Dataframe WHEN caseJuly 28, 2022
try something like df.withColumn("type", when(col("flag1"), lit("type_1")).when(!col("flag1") && (col("flag2") || col("flag3") || col("flag4") || col("flag5")), lit("type2")).otherwise(lit("other")))
tagu on Free Online SQL to PySpark ConverterJuly 20, 2022
It will be great if you can have a link to the convertor. It helps the community for anyone starting…

Copyright © 2025 SQL & Hadoop