生成SequenceFile(Generating a SequenceFile)

 给定以下格式的数据（tag_uri image_uri image_uri image_uri ...），我需要将它们转换为Hadoop SequenceFile格式，以便Mahout进一步处理（例如聚类） 
 
http://flickr.com/photos/tags/100commentgroup http://flickr.com/photos/34254318@N06/4019040356 http://flickr.com/photos/46857830@N03/5651576112
http://flickr.com/photos/tags/100faves http://flickr.com/photos/21207178@N07/5441742937
...
 
 在此之前，我将输入转换为csv（或arff），如下所示 
 
http://flickr.com/photos/tags/100commentgroup,http://flickr.com/photos/tags/100faves,...
0,1,...
1,1,...
...
 
 每行描述一个标签。 然后将arff文件转换为mahout使用的矢量文件以供进一步处理。 我试图跳过arff生成部分，然后生成一个sequenceFile。 如果我没有弄错，要将我的数据表示为sequenceFile，我需要将$ tag_uri作为键存储每行数据，然后将$ image_vector作为值存储。 这样做的正确方法是什么（如果可能的话，我可以将每行的tag_url包含在某个地方的序列文件中）吗？ 
 
 我找到的一些参考文献，但不确定它们是否相关： 
 
 
 
 编写SequenceFile 
 
 
 格式化svd矩阵分解的输入矩阵 （我可以将矩阵存储在这种形式中吗？） 
 
 
 RandomAccessSparseVector （考虑到我只列出分配给定标签的图像而不是一行中的所有图像，是否可以使用此向量表示它？） 
 
 
 SequenceFile写 
 
 
 SequenceFile解释 
 

Given data in the following format (tag_uri image_uri image_uri image_uri ...), I need to turn them into Hadoop SequenceFile format for further processing by Mahout (e.g. clustering)
 
http://flickr.com/photos/tags/100commentgroup http://flickr.com/photos/34254318@N06/4019040356 http://flickr.com/photos/46857830@N03/5651576112
http://flickr.com/photos/tags/100faves http://flickr.com/photos/21207178@N07/5441742937
...
 
Before this I would turn the input into csv (or arff) as follows
 
http://flickr.com/photos/tags/100commentgroup,http://flickr.com/photos/tags/100faves,...
0,1,...
1,1,...
...
 
with each row describes one tag. Then the arff file is converted into a vector file used by mahout for further processing. I am trying to skip the arff generation part, and generate a sequenceFile instead. If I am not mistaken, to represent my data as a sequenceFile, I would need to store each row of the data with $tag_uri as key, then $image_vector as value. What is the proper way of doing this (if possible, can I have the tag_url for each row to be included in the sequencefile somewhere)?
 
Some references that I found, but not sure if they are relevant:
 
 
 
Writing a SequenceFile
 
 
Formatting input matrix for svd matrix factorization (can I store my matrix in this form?)
 
 
RandomAccessSparseVector (considering I only list images that are assigned with a given tag instead of all the images in a line, is it possible to represent it using this vector?)
 
 
SequenceFile write
 
 
SequenceFile explanation
 

原文：https://stackoverflow.com/questions/7062327