New Topic

programming forums Java Mobile Certification Databases Caching Books Engineering Micro Controllers OS Languages Paradigms IDEs Build Tools Frameworks Application Servers Open Source This Site Careers Other Pie Elite all forums

this forum made possible by our volunteer staff, including ...

Marshals:

Tim Cooke
Campbell Ritchie
Paul Clapham
Ron McLeod
Liutauras Vilda

Sheriffs:

Jeanne Boyarsky
Rob Spoor
Bear Bibeault

Saloon Keepers:

Jesse Silverman
Tim Moores
Stephan van Hulst
Tim Holloway
Carey Brown

Bartenders:

Piet Souris
Al Hobbs
salvin francis

Other Big Data

Other NoSQL questions, tools or topics

Best this year

Does Python execution being slower than Java, affect its execution time when processing Big Data

19 replies

Is Parquet used only as an intermediate format as it looks more machine readable than human readable

10 replies

stored procedure with Oracle

1 reply

Other Big Data

SQL

1 reply

What makes the number of output files in pyspark output keep varying

0 replies

Where is the SQL Server Database Trigger Wizard or Dialog Box?

0 replies

Cybersecurity

0 replies

How Can I Gathered Registered User Detail in Database I'm Non Technical Guy.

0 replies

Kafka Structured streaming application throwing IllegalStateException when there is a gap in the off

0 replies

If one cannot query from inside the JSON using DynamoDb then what is the use of storing JSON docs?

3 replies

Is Kafka Connect not based on producer subscriber model unlike Kafka?

0 replies

What Big Data fundamentals should one learn when big data technologies will keep changing

0 replies

Aggregated results without duplicates on multiple columns each filtered differently

0 replies

When does in memory code get triggered in dataframes as compared to action call in RDD

0 replies

When to use Pandas dataframe instead of PySpark dataframe?

0 replies

Compare rows within a group in a dataframe

0 replies

AcknowledgingMessageListener vs @KafkaListener

0 replies

How does lazy evaluation happen in dataframes in Spark which do not have actions unlike RDDs

2 replies

Why is RDD called fundamental data structure of Spark when Dataframes and Datasets don't use RDDs

1 reply

Is Kafka like an asynchronous queue which gives fast and fault tolerant performance with huge data?

0 replies

More »
Best this month

Does Python execution being slower than Java, affect its execution time when processing Big Data

19 replies

stored procedure with Oracle

1 reply

Other Big Data

SQL

1 reply

More »
Other Big Data Forum at JavaRanch

Other Big Data

SQL

2 days ago 1 reply

Does Python execution being slower than Java, affect its execution time when processing Big Data

5 days ago 19 replies

stored procedure with Oracle

3 weeks ago 1 reply

What is the relationship between Hadoop and ETL ?

1 month ago 13 replies

What makes the number of output files in pyspark output keep varying

1 month ago 0 replies

Where is the SQL Server Database Trigger Wizard or Dialog Box?

2 months ago 0 replies

Kafka Structured streaming application throwing IllegalStateException when there is a gap in the off

5 months ago 0 replies

Is Kafka Connect not based on producer subscriber model unlike Kafka?

6 months ago 0 replies

What Big Data fundamentals should one learn when big data technologies will keep changing

6 months ago 0 replies

Aggregated results without duplicates on multiple columns each filtered differently

7 months ago 0 replies

When does in memory code get triggered in dataframes as compared to action call in RDD

8 months ago 0 replies

When to use Pandas dataframe instead of PySpark dataframe?

8 months ago 0 replies

Compare rows within a group in a dataframe

10 months ago 0 replies

AcknowledgingMessageListener vs @KafkaListener

10 months ago 0 replies

Is Kafka like an asynchronous queue which gives fast and fault tolerant performance with huge data?

11 months ago 0 replies

If one cannot query from inside the JSON using DynamoDb then what is the use of storing JSON docs?

11 months ago 3 replies

How to query in DynamoDb using a parameter which is a field inside JSON?

11 months ago 0 replies

If already using AWS in the project for what kind of use case would one choose DynamoDB over MongoDb

11 months ago 0 replies

Why is RDD called fundamental data structure of Spark when Dataframes and Datasets don't use RDDs

11 months ago 1 reply

Is Parquet used only as an intermediate format as it looks more machine readable than human readable

11 months ago 10 replies

For creating Spark cluster on EC2 without hadoop is there some tool like Cloudera Manager to ease it

11 months ago 0 replies

How does lazy evaluation happen in dataframes in Spark which do not have actions unlike RDDs

11 months ago 2 replies

When should we use Dataframes instead of Spark SQL and vice versa

11 months ago 1 reply

Are Spark SQL and Hive used together only in case of existing Hive or for new requirements too?

11 months ago 0 replies

Does the Driver Node in Spark do computation too like worker nodes besides giving tasks to workers ?

11 months ago 0 replies

Can one read Person JSON data into RDD of type Person using RDD?

11 months ago 0 replies

"The number of columns doesn't match" on trying to create DataFrame from JSON

11 months ago 0 replies

Is this kind of data structured or unstructured/semistructured?

1 year ago 12 replies

Unlike Map Reduce which is not used much now, what components from hadoop are still used a lot today

1 year ago 1 reply

When should one go for a Document Oriented noSQL database and when for a column oriented one?

1 year ago 3 replies

Is funsuite an alternative to JUnit for testing Spark applications?

1 year ago 2 replies

Is Scala still the most preferred for Spark even when using Datasets and Dataframes instead of RDD?

1 year ago 2 replies

Need guidance on what should my next learning path be in big data?

1 year ago 2 replies
- 1
- 2
- 3
- 4
- 5
- 6
- ►
Forum leaders: Tim Holloway
Databases
- Object Relational Mapping 42349
- JDBC and Relational Databases 86453
- MongoDB 574
- Hadoop 1302
- Neo4j 136
- Riak 1
- Big Table 86
- Other Big Data 535

What do the icons mean:

= Topic with 1 to 5 flags
= Topic with 5 or more flags
= Topic with 10 or more flags
= Topic with unread post(s)

Other Big Data

Best this year

Does Python execution being slower than Java, affect its execution time when processing Big Data

Is Parquet used only as an intermediate format as it looks more machine readable than human readable

stored procedure with Oracle

SQL

What makes the number of output files in pyspark output keep varying

Where is the SQL Server Database Trigger Wizard or Dialog Box?

Cybersecurity

How Can I Gathered Registered User Detail in Database I'm Non Technical Guy.

Kafka Structured streaming application throwing IllegalStateException when there is a gap in the off

If one cannot query from inside the JSON using DynamoDb then what is the use of storing JSON docs?

Is Kafka Connect not based on producer subscriber model unlike Kafka?

What Big Data fundamentals should one learn when big data technologies will keep changing

Aggregated results without duplicates on multiple columns each filtered differently

When does in memory code get triggered in dataframes as compared to action call in RDD

When to use Pandas dataframe instead of PySpark dataframe?

Compare rows within a group in a dataframe

AcknowledgingMessageListener vs @KafkaListener

How does lazy evaluation happen in dataframes in Spark which do not have actions unlike RDDs

Why is RDD called fundamental data structure of Spark when Dataframes and Datasets don't use RDDs

Is Kafka like an asynchronous queue which gives fast and fault tolerant performance with huge data?

Best this month

Does Python execution being slower than Java, affect its execution time when processing Big Data

stored procedure with Oracle

SQL

Other Big Data Forum at JavaRanch

SQL

Does Python execution being slower than Java, affect its execution time when processing Big Data

stored procedure with Oracle

What is the relationship between Hadoop and ETL ?

What makes the number of output files in pyspark output keep varying

Where is the SQL Server Database Trigger Wizard or Dialog Box?

Kafka Structured streaming application throwing IllegalStateException when there is a gap in the off

Is Kafka Connect not based on producer subscriber model unlike Kafka?

What Big Data fundamentals should one learn when big data technologies will keep changing

Aggregated results without duplicates on multiple columns each filtered differently

When does in memory code get triggered in dataframes as compared to action call in RDD

When to use Pandas dataframe instead of PySpark dataframe?

Compare rows within a group in a dataframe

AcknowledgingMessageListener vs @KafkaListener

Is Kafka like an asynchronous queue which gives fast and fault tolerant performance with huge data?

If one cannot query from inside the JSON using DynamoDb then what is the use of storing JSON docs?

How to query in DynamoDb using a parameter which is a field inside JSON?

If already using AWS in the project for what kind of use case would one choose DynamoDB over MongoDb

Why is RDD called fundamental data structure of Spark when Dataframes and Datasets don't use RDDs

Is Parquet used only as an intermediate format as it looks more machine readable than human readable

For creating Spark cluster on EC2 without hadoop is there some tool like Cloudera Manager to ease it

How does lazy evaluation happen in dataframes in Spark which do not have actions unlike RDDs

When should we use Dataframes instead of Spark SQL and vice versa

Are Spark SQL and Hive used together only in case of existing Hive or for new requirements too?

Does the Driver Node in Spark do computation too like worker nodes besides giving tasks to workers ?

Can one read Person JSON data into RDD of type Person using RDD?

"The number of columns doesn't match" on trying to create DataFrame from JSON

Is this kind of data structured or unstructured/semistructured?

Unlike Map Reduce which is not used much now, what components from hadoop are still used a lot today

When should one go for a Document Oriented noSQL database and when for a column oriented one?

Is funsuite an alternative to JUnit for testing Spark applications?

Is Scala still the most preferred for Spark even when using Datasets and Dataframes instead of RDD?

Need guidance on what should my next learning path be in big data?

Databases