Branch 2.7.7#2

Open

martin-boettcher wants to merge 120 commits intobcdev:branch-2.7.4from

apache:branch-2.7.7

Commits on Jul 28, 2017

Preparing for 2.7.5 development
shvachko
committed

Commits on Aug 2, 2017

HADOOP-14702. Fix formatting issue and regression caused by conversion from APT to Markdown. Contributed by Doris Gu.
iwasakims
committed

Commits on Aug 5, 2017

Set the release date for 2.7.4.
shvachko
committed

Commits on Aug 9, 2017

HDFS-12157. Do fsyncDirectory(..) outside of FSDataset lock. Contributed by Vinayakumar B.
kihwal
committed

Commits on Aug 17, 2017

YARN-6959. RM may allocate wrong AM Container for new attempt. Contributed by Yuqi Wang
jian-he
committed

Commits on Aug 30, 2017

MAPREDUCE-6937. Backport MAPREDUCE-6870 to branch-2 while preserving compatibility. (Peter Bacsko via Haibo Chen)
haibchen
committed
HDFS-9153. Pretty-format the output for DFSIO. Contributed by Kai Zheng.

Haohui Mai
authored and
shvachko
committed
MAPREDUCE-6931. Remove TestDFSIO "Total Throughput" calculation. Contributed by Dennis Huo.
shvachko
committed
HDFS-8797. WebHdfsFileSystem creates too many connections for pread. Contributed by Jing Zhao.

Jing9
authored and
shvachko
committed
HDFS-9107. Prevent NN's unrecoverable death spiral after full GC (Daryn Sharp via Colin P. McCabe)

Colin Patrick Mccabe
authored and
shvachko
committed

Commits on Sep 6, 2017

Commits on Sep 8, 2017

Commits on Sep 13, 2017

Commits on Sep 14, 2017

HDFS-10711. Optimize FSPermissionChecker group membership check. Contributed by Daryn Sharp.

kihwal
authored and
shvachko
committed

Commits on Sep 15, 2017

Commits on Sep 21, 2017

YARN-5195. RM intermittently crashed with NPE while handling APP_ATTEMPT_REMOVED event when async-scheduling enabled in CapacityScheduler. Contributed by sandflee and Jonathan Hung
jlowe
committed

Commits on Sep 28, 2017

Commits on Sep 29, 2017

YARN-7084. TestSchedulingMonitor#testRMStarts fails sporadically. Contributed by Jason Lowe.
erichadoop
committed

Commits on Oct 2, 2017

Commits on Oct 13, 2017

Commits on Oct 18, 2017

HDFS-12420. Add an option to disallow 'namenode format -force'. Contributed by Ajay Kumar.

arp7
authored and
zhe-thoughts
committed

Commits on Oct 19, 2017

Commits on Oct 24, 2017

Revert "HDFS-12502. nntop should support a category based on FilesInGetListingOps."
zhe-thoughts
committed

Commits on Oct 25, 2017

Remove parent's env vars from child processes. Contributed by Vinayakumar B.
naga-apache
committed

Commits on Oct 31, 2017

HADOOP-14919. BZip2 drops records when reading data in splits. Contributed by Jason Lowe
jlowe
committed

Commits on Nov 6, 2017

MAPREDUCE-6975. Logging task counters. Contributed by Prabhu Joseph.
naga-apache
committed

Commits on Nov 9, 2017

Fixing Job History Server Configuration parsing. (Jason Lowe via asuresh)
xslogic
committed

Commits on Nov 15, 2017

HDFS-8829. Make SO_RCVBUF and SO_SNDBUF size configurable for DataTransferProtocol sockets and allow configuring auto-tuning (He Tianyi via Colin P. McCabe)

Colin Patrick Mccabe
authored and
zhe-thoughts
committed

Commits on Nov 18, 2017

HDFS-12823. Backport HDFS-9259 "Make SO_SNDBUF size configurable at DFSClient" to branch-2.7. (Erik Krogen via zhz)
zhe-thoughts
committed

Commits on Nov 29, 2017

HDFS-12832. INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit. Contribuited by Konstantin Shvachko.
shvachko
committed

Commits on Dec 1, 2017

Commits on Dec 2, 2017

Commits on Dec 4, 2017

MAPREDUCE-6165. [JDK8] TestCombineFileInputFormat failed on JDK8. Contributed by Akira AJISAKA.

oza
authored and
zhe-thoughts
committed

Commits on Dec 7, 2017

Update CHANGES.txt for HADOOP-14867, HADOOP-14919, HDFS-12578, HDFS-12596, HDFS-8829, MAPREDUCE-6937, MAPREDUCE-6975, YARN-6959, YARN-7084
shvachko
committed

Commits on Dec 8, 2017

MAPREDUCE-5124. AM lacks flow control for task events. Contributed by Peter Bacsko
jlowe
committed

Commits on Dec 15, 2017

Commits on Dec 16, 2017

Update index.md.vm to reflect summary of changes in release 2.7.5
shvachko
committed

Commits on Dec 18, 2017

YARN-7661. NodeManager metrics return wrong value after update node resource. Contributed by Yang Wang
jlowe
committed

Commits on Dec 20, 2017

Commits on Jan 3, 2018

MAPREDUCE-7028. Concurrent task progress updates causing NPE in Application Master. Contributed by Gergo Repas
jlowe
committed

Commits on Jan 4, 2018

HDFS-12347. TestBalancerRPCDelay#testBalancerRPCDelay fails very frequently. Contributed by Bharat Viswanadham

Tsz-Wo Nicholas Sze
authored and
brahmareddybattula
committed
HADOOP-12181. Fix intermittent test failure of TestZKSignerSecretProvider. Contributed by Masatake Iwasaki.

Haohui Mai
authored and
rkanter
committed
HADOOP-12611. TestZKSignerSecretProvider#testMultipleInit occasionally fail (ebadger via rkanter)
rkanter
committed
HADOOP-14246. Authentication Tokens should use SecureRandom instead of Random and 256 bit secrets

templedf
authored and
rkanter
committed

Commits on Jan 19, 2018

Commits on Jan 26, 2018

MAPREDUCE-7020. Task timeout in uber mode can crash AM. Contributed by Peter Bacsko
jlowe
committed

Commits on Feb 6, 2018

HADOOP-15212. Add independent secret manager method for logging expired tokens. Contributed by Daryn Sharp.
kihwal
committed

Commits on Feb 8, 2018

HDFS-13120. Snapshot diff could be corrupted after concat. Contributed by Xiaoyu Yao.
xiaoyuyao
committed

Commits on Feb 9, 2018

HDFS-7959. WebHdfs logging is missing on Datanode (Kihwal Lee via sjlee)

kihwal
authored and
shvachko
committed

Commits on Feb 12, 2018

Commits on Feb 14, 2018

HADOOP-9477. Add posixGroups support for LDAP groups mapping service. (Dapeng Sun via Yongjun Zhang)

Yongjun Zhang
authored and
shvachko
committed
HADOOP-12568. Update core-default.xml to describe posixGroups support. Contributed by Wei-Chiu Chuang.

aajisaka
authored and
shvachko
committed

Commits on Feb 15, 2018

Commits on Feb 16, 2018

HADOOP-15206. BZip2 drops and duplicates records when input split size is small. Contributed by Aki Tanaka
jlowe
committed

Commits on Feb 21, 2018

HDFS-11187. Optimize disk access for last partial chunk checksum of Finalized replica. Contributed by Gabor Bota, Wei-Chiu Chuang.
xiao-chen
committed

Commits on Feb 22, 2018

HDFS-4210. Throw helpful exception when DNS entry for JournalNode cannot be resolved. Contributed by Charles Lamb and John Zhuge.

xiao-chen
authored and
shvachko
committed

Commits on Mar 4, 2018

HADOOP-15283. Upgrade from findbugs 3.0.1 to spotbugs 3.1.2 in branch-2 to fix docker image build.
aajisaka
committed

Commits on Mar 6, 2018

HADOOP-15279. increase maven heap size recommendations

aw-was-here
authored and
aajisaka
committed

Commits on Mar 7, 2018

Commits on Mar 17, 2018

Revert "HADOOP-13119. Add ability to secure log servlet using proxy users. Contribute by Yuanbo Liu."
shvachko
committed

Commits on Mar 22, 2018

Commits on Mar 27, 2018

HDFS-12299. Race Between update pipeline and DN Re-Registration. Contributed by Brahma Reddy Battula.

kihwal
authored and
shvachko
committed

Commits on Mar 28, 2018

HADOOP-15345. Backport HADOOP-12185 to branch-2.7: NetworkTopology is not efficient adding/getting/removing nodes. Contributed by He Xiaoqiao.
Inigo Goiri
committed

Commits on Mar 30, 2018

Commits on Mar 31, 2018

Commits on Apr 6, 2018

Preparing for 2.7.7 development
shvachko
committed

Commits on Apr 13, 2018

HADOOP-14970. MiniHadoopClusterManager doesn't respect lack of format option. Contributed by Erik Krogen

xkrogen
authored and
shvachko
committed

Commits on Apr 17, 2018

Set the release date for 2.7.6
shvachko
committed

Commits on Apr 18, 2018

Update index.md.vm to reflect summary of changes in release 2.7.6
shvachko
committed

Commits on Apr 30, 2018

HDFS-12156. TestFSImage fails without -Pnative

aajisaka
authored and
jojochuang
committed

Commits on May 7, 2018

HDFS-13486. Backport HDFS-11817 (A faulty node can cause a lease leak and NPE on accessing data) to branch-2.7. Contributed by Kihwal Lee.
jojochuang
committed

Commits on May 21, 2018

Skip the proxy user check if the ugi has not been initialized. Contributed by Daryn Sharp
shahrs87
committed

Commits on May 23, 2018

Commits on May 25, 2018

HADOOP-15473. Configure serialFilter in KeyProvider to avoid UnrecoverableKeyException caused by JDK-8189997. Contributed by Gabor Bota.
xiao-chen
committed

Commits on May 29, 2018

Additional check when unpacking archives. Contributed by Wilfred Spiegelenburg.
kihwal
committed

Commits on Jun 1, 2018

HDFS-13602. Add checkOperation(WRITE) checks in FSNamesystem. Contributed by Chao Sun.

sunchao
authored and
shvachko
committed

Commits on Jun 3, 2018

Commits on Jun 5, 2018

Set the release date for 2.7.7-RC0
steveloughran
committed

Commits on Jun 6, 2018

Set the release date for 2.7.7-RC0
steveloughran
committed

Commits on Jul 6, 2018

HADOOP-15509. Set the release date for 2.7.7-RC0 to 2018-07-06.
steveloughran
committed

Commits on Jul 18, 2018

HADOOP-15509. Set the release date for 2.7.7 to 2018-07-06.
steveloughran
committed