Changing log level of Spark in Cloudera QucikStart VM

Step 01 : Start Cloudera QuickStart VM.

Step 02 : Open the terminal and then start spark-shell.

 $ spark-shell 

Step 03 : Spark installed in QucikStartVM in the below mentioned location

 
$ sudo su root
$ cd /usr/lib/spark/conf
$ cp log4j.properties.template log4j.properties
$ chmod 777 log4j.properties

Change the value from INFO to WARN

Naveen P.N

12+ years of experience in IT with vast experience in executing complex projects using Java, Micro Services , Big Data and Cloud Platforms. I found NPN Training Pvt Ltd a India based startup to provide high quality training for IT professionals. I have trained more than 3000+ IT professionals and helped them to succeed in their career in different technologies. I am very passionate about Technology and Training. I have spent 12 years at Siemens, Yahoo, Amazon and Cisco, developing and managing technology.