Skip to content
  • Categories
    • Longform Tutorials
      • Your First Cluster
      • HDPCD Exam
      • Crunch
    • Ingestion
      • Sqoop
      • NiFi
    • Schedulers
      • Falcon
      • Oozie
      • Airflow
    • Processing
      • Hive
      • Spark
      • Pig
    • Storage / System
      • Orc
      • HDFS
      • Yarn
    • Editorials
    • Analytics
  • Contributors
  • About Us
  • The Spark Starter Guide
  • Our 2019 Spark Summit Talks
Search
Close

Hadoopsters

Helping Folks Process Big Data Since 2015

Category: Yarn

How to Override a Spark Dependency in Client or Cluster Mode

May 8, 2019June 21, 2019 Landon Robinson5 Comments
Jars!

In this post, we’ll cover a simple way to override a jar, library, or dependency in your Spark application that may already exist in the Spark classpath, which would cause you runtime issues.

Recently, I needed to use a specific library as a dependency: Google’s GSON.

Read More »

Cluster Usage with `yarn top`

June 30, 2017June 21, 2019 James BarneyLeave a comment

Abraham Lincoln was the original inventor of the ‘top’ command in 1864 so he could keep better track of his many tophats. 

From the command line, it’s easy to see the current state of any running applications in your YARN cluster by issuing the yarn top  command. Read More »

Writers

  • Craig Covey
  • James Barney
  • Landon Robinson

Follow Hadoopsters on WordPress.com

Site Traffic

  • 267,801 Hadoopsters Helped
Blog at WordPress.com.
Back to top
  • Follow Following
    • Hadoopsters
    • Join 85 other followers
    • Already have a WordPress.com account? Log in now.
    • Hadoopsters
    • Customize
    • Follow Following
    • Sign up
    • Log in
    • Report this content
    • View site in Reader
    • Manage subscriptions
    • Collapse this bar
 

Loading Comments...