Discussion:
Hadoop source code modification.
Madhvaraj Shetty
2016-11-15 11:36:23 UTC
Permalink
Hello,

I am working in the area of hadoop, especially i want to improve hadoop
security.

So i need procedure for modifying hadoop source code.
I have visited this <https://wiki.apache.org/hadoop/HowToContribute>and
able to compile hadoop from the source code, but i need to modify the part
of the code.

Is it compulsory to compile the whole hadoop, can i compile/debug a part of
it. Any steps for that.


Thank you.
Naganarasimha G R (Naga)
2016-11-15 12:41:50 UTC
Permalink
Hi Madhvaraj,
Its not required to compile everytime, as you have followed the steps in <https://wiki.apache.org/hadoop/HowToContribute>.
You can go to specific project and run " mvn clean install"

Regards,
+ Naga
________________________________________
From: Madhvaraj Shetty [***@gmail.com]
Sent: Tuesday, November 15, 2016 17:06
To: ***@hadoop.apache.org
Subject: Hadoop source code modification.

Hello,

I am working in the area of hadoop, especially i want to improve hadoop
security.

So i need procedure for modifying hadoop source code.
I have visited this <https://wiki.apache.org/hadoop/HowToContribute>and
able to compile hadoop from the source code, but i need to modify the part
of the code.

Is it compulsory to compile the whole hadoop, can i compile/debug a part of
it. Any steps for that.


Thank you.

---------------------------------------------------------------------
To unsubscribe, e-mail: general-***@hadoop.apache.org
For additional commands, e-mail: general-***@hadoop.apache.org
Madhvaraj Shetty
2016-11-18 16:19:03 UTC
Permalink
Hi,

After producing eclipse files from maven, i successfully imported hadoop
project to eclipse.(hadoop-common-project)

But it has few errors in eclipse:

AvroRecord cannot be resolved to a type
EchoRequestProto cannot be resolved to a type
TestProtobufRpcProto cannot be resolved
TestProtobufRpcProto cannot be resolved to a type

I think it is related protocol buffer, but i can't figure out where it is.

Thanks


On Tue, Nov 15, 2016 at 6:27 PM, Mallanagouda Patil <
Hi,
Some time back I have written an article on how to setup development
environment for Hadoop and also how to debug.
http://www.codeproject.com/Articles/1067129/Debugging-
Hadoop-HDFS-using-IntelliJ-IDEA-on-Linux
You can reach me for any issues.
Thanks
Mallan
On Nov 15, 2016 5:49 PM, "Brahma Reddy Battula" <
(Keeping user-mailing list in loop.)
You can compile corresponding module which you modified.
Please refer "Where to run Maven from?" from the following.
https://github.com/apache/hadoop/blob/trunk/BUILDING.txt
Regards
Brahma Reddy Battula
-----Original Message-----
Sent: 15 November 2016 19:36
Subject: Hadoop source code modification.
Hello,
I am working in the area of hadoop, especially i want to improve hadoop
security.
So i need procedure for modifying hadoop source code.
I have visited this <https://wiki.apache.org/hadoop/HowToContribute>and
able to compile hadoop from the source code, but i need to modify the
part of the code.
Is it compulsory to compile the whole hadoop, can i compile/debug a part
of it. Any steps for that.
Thank you.
---------------------------------------------------------------------
--
--
*Madhvaraj M Shetty,Research Scholar,Department of Computer
Science,Mangalore University, Mangalagangothri, Mangalore, Karnataka -
574199.*
*E-mail: ***@gmail.com <***@gmail.com>*
*Phone: 9741449181*
Suraj Nayak
2017-01-31 03:58:48 UTC
Permalink
Follow https://wiki.apache.org/hadoop/EclipseEnvironment.

You need to add generated sources of the project to include generated Proto
classes.

This blog
<http://blog.cloudera.com/blog/2013/05/how-to-configure-eclipse-for-hadoop-contributions/>
is old, but will give you some idea on how to import the generated java
classes.

*The generated sources (e.g. *Proto.java files that are generated using
protoc) might not be directly linked and can show up as errors. To fix
them, select the project and configure the build path to include the java
files under target/generated-sources and target/generated-test-sources. For
inclusion pattern, select “**/*.java”.*
*- Source
: http://blog.cloudera.com/blog/2013/05/how-to-configure-eclipse-for-hadoop-contributions/
<http://blog.cloudera.com/blog/2013/05/how-to-configure-eclipse-for-hadoop-contributions/>*
Post by Madhvaraj Shetty
Hi,
After producing eclipse files from maven, i successfully imported hadoop
project to eclipse.(hadoop-common-project)
AvroRecord cannot be resolved to a type
EchoRequestProto cannot be resolved to a type
TestProtobufRpcProto cannot be resolved
TestProtobufRpcProto cannot be resolved to a type
I think it is related protocol buffer, but i can't figure out where it is.
Thanks
On Tue, Nov 15, 2016 at 6:27 PM, Mallanagouda Patil <
Hi,
Some time back I have written an article on how to setup development
environment for Hadoop and also how to debug.
http://www.codeproject.com/Articles/1067129/Debugging-
Hadoop-HDFS-using-IntelliJ-IDEA-on-Linux
You can reach me for any issues.
Thanks
Mallan
On Nov 15, 2016 5:49 PM, "Brahma Reddy Battula" <
(Keeping user-mailing list in loop.)
You can compile corresponding module which you modified.
Please refer "Where to run Maven from?" from the following.
https://github.com/apache/hadoop/blob/trunk/BUILDING.txt
Regards
Brahma Reddy Battula
-----Original Message-----
Sent: 15 November 2016 19:36
Subject: Hadoop source code modification.
Hello,
I am working in the area of hadoop, especially i want to improve hadoop
security.
So i need procedure for modifying hadoop source code.
I have visited this <https://wiki.apache.org/hadoop/HowToContribute>and
able to compile hadoop from the source code, but i need to modify the
part of the code.
Is it compulsory to compile the whole hadoop, can i compile/debug a part
of it. Any steps for that.
Thank you.
---------------------------------------------------------------------
--
--
*Madhvaraj M Shetty,Research Scholar,Department of Computer
Science,Mangalore University, Mangalagangothri, Mangalore, Karnataka -
574199.*
*Phone: 9741449181*
--
Thanks
Suraj Nayak M
Loading...