首页 \ 问答 \ Hadoop以递归方式连接文件以维护目录结构(Hadoop concatenate files recursively maintaining directory structure)

Hadoop以递归方式连接文件以维护目录结构(Hadoop concatenate files recursively maintaining directory structure)

 我想在一个目录下添加2个目录的文件，同时保持目录结构。  
 我有目录1和目录2，每个目录有大约80个子目录，结构如下所示。  
 HDFS上的目录1：  
 
  /用户/ hadoop的/ 1 / ABC / FILE11  
  /用户/ hadoop的/ 1 / DEF / file12  
  /用户/ hadoop的/ 1 / GHI / file13  
  /用户/ hadoop的/ 1 / JKL / FILE14  
  /用户/ hadoop的/ 1 / MNO / file15  
 
 HDFS目录2：  
 
  /用户/ hadoop的/ 2 / ABC / file26  
  /用户/ hadoop的/ 2 / GHI / file27  
  /用户/ hadoop的/ 2 / MNO / file28  
 
 我想将目录1的file11和目录2的文件26组合在一个目录下，目录1的文件13和目录27，依此类推。 目标目录是目录1。  
 从dir 2添加到dir 1的文件应与子目录的路径匹配。  
 期望的输出：  
 
  / user / hadoop / 1 / abc / file11，/ user / hadoop / 1 / abc / file26  
  /用户/ hadoop的/ 1 / DEF / file12  
  / user / hadoop / 1 / ghi / file13，/ user / hadoop / 1 / ghi / file27  
  /用户/ hadoop的/ 1 / JKL / FILE14  
  / user / hadoop / 1 / mno / file15，/ user / hadoop / 1 / mno / file28  
 
 任何帮助表示赞赏。 

I would like to add files of 2 directories under a single directory, also maintaining the directory structure. 
i have directory 1 and directory 2, each with approx 80 subdirectories structured in the way shown below. 
Directory 1 on HDFS: 
 
 /user/hadoop/1/abc/file11 
 /user/hadoop/1/def/file12 
 /user/hadoop/1/ghi/file13 
 /user/hadoop/1/jkl/file14 
 /user/hadoop/1/mno/file15 
 
Directory 2 on HDFS: 
 
 /user/hadoop/2/abc/file26 
 /user/hadoop/2/ghi/file27 
 /user/hadoop/2/mno/file28 
 
i want to combine file11 of dir 1 and file 26 of dir 2 to be present under a single directory, file 13 of dir 1 and dir 27 and so on. Destination directory is directory 1. 
The files that are to the added from dir 2 to dir 1 should match the path of subdirectory. 
Desired Output: 
 
 /user/hadoop/1/abc/file11 , /user/hadoop/1/abc/file26 
 /user/hadoop/1/def/file12 
 /user/hadoop/1/ghi/file13 , /user/hadoop/1/ghi/file27 
 /user/hadoop/1/jkl/file14 
 /user/hadoop/1/mno/file15 , /user/hadoop/1/mno/file28 
 
Any help is appreciated.

原文：https://stackoverflow.com/questions/37616953

更新时间：2023-11-08 06:11

最满意答案

 找到了！ 我必须在Example1类上添加一个额外的属性，如下所示：  
        [XmlElement("Example2")]
        public List<Example2Type> Example2
        {
            get
            {
                return this.example2Field;
            }
            set
            {
                this.example2Field = value;
            }
        }

Found it! I had to add an extra attribute on the Example1 Class like this: 
        [XmlElement("Example2")]
        public List<Example2Type> Example2
        {
            get
            {
                return this.example2Field;
            }
            set
            {
                this.example2Field = value;
            }
        }

Hadoop以递归方式连接文件以维护目录结构(Hadoop concatenate files recursively maintaining directory structure)

最满意答案

相关问答

XSD - 没有？(XSD - without ?)[2022-04-20]

XJC：为complexTypes生成子包(XJC: Generate subpackages for complexTypes)[2023-01-20]

在XSD中引用ComplexType / Sequence元素内的ComplexType元素(Referencing ComplexType Elements within ComplexType/Sequence Elements in XSD)[2021-10-25]

XSD - 如何描述其子节点和任何元素中的一个或多个的complexType(XSD - How can I describe a complexType whose children and 1 or more of any element)[2022-03-16]

对象的序列化（使用包含复杂类型的xsd创建）将complextype作为元素返回(Serialization of objects (created with xsd containing complextypes) returns complextype as element)[2022-03-21]

调用返回complexType的WS(Calling WS that returns complexType)[2021-12-17]

使用元素扩展xsd complexType(Extend xsd complexType with elements)[2022-02-15]

XSD：重用complexType的子元素？(XSD: reuse sub-elements of complexType?)[2024-01-20]

XSD：具有相同名称的ComplexType元素(XSD : ComplexType Element With the Same Name)[2023-04-20]

如何检测XSD文件中的SimpleType？(How to detect the SimpleType in XSD file?)[2021-12-20]

相关文章

最新问答