为什么gsutil rsync会重新下载我们所有的文件？(Why is gsutil rsync re-downloading all our files?)

 我们一直在使用gsutil -m rsync -r来保持开发和部署框与GCS存储桶同步近2年而没有任何问题。 桶中有大约85k个物体。 
 
 直到最近，这完美地工作：我们每隔15分左右运行一个部署框 - > GCS rsync，以备份所有新上传的资源，然后每当我们想要刷新本地时，再使用GCS - > dev框rsync dev数据（在OSX El Capitan上运行）。 
 
 然而，在过去的几个月里，GCS-> dev rsync开始膨胀，下载越来越多的图像。 
 
 最初我只是觉得“很棒，我们上传了更多的资源”，但它的增长速度比数据快，直到今天它似乎正在下载整个85k图像。 
 
 我已经仔细检查过我在正确的位置，命令是否正确，路径是否正确等等。对于所有gsutil输出都是通过“正在复制...”和“正在下载”的大量滚动来滚动。 ..“消息，好好并行使用我们的100mbps连接，当我去另一个终端并运行find . -type f | wc -l find . -type f | wc -l find . -type f | wc -l在目标目录上每隔10秒，它显示每分钟只添加2或3个新文件。 我看一下gsutil说它现在正在下载的文件的修改时间，而且大多数情况下它们已经过时了，很多都没有在一年或更长时间内发生变化。 含义：它使用大量的时间和带宽下载所有数据，所有这些都是为了几百个文件。 
 
 最近的OSX gsutil版本有什么变化吗？ 可能有错误吗？ 我怎么会开始追踪这个呢？ 还是报道呢？ 新闻组gsutil-discuss和gs-discussion已经存档， gce-discussion就是使用GCE实例中的gsutil 。 
 
 谢谢！ 

We've been using gsutil -m rsync -r to keep dev and deploy boxes in sync with a GCS bucket for nearly 2 years without any problem. There are about 85k objects in the bucket.
 
Until recently, this worked perfectly: we'd run a deploy-box -> GCS rsync every 15 mins or so, to keep all new uploaded resource backed up, and then a GCS -> dev box rsync whenever we wanted to refresh the local dev data (running on OSX El Capitan).
 
Within the last couple of months, though, the GCS->dev rsync has started to bloat, downloading more and more images.
 
Initially I just thought "great, we're getting more resources uploaded", but it's been growing way faster than the data, until today when it seems to be downloading the whole 85k images.
 
I've double-checked I'm in the right place, the command is correct, the paths are correct, etc. For all that the gsutil output is scrolling by with reams and reams of "Copying..." and "Downloading..." messages, making good parallel use of our 100mbps connection, when I go to another terminal and run find . -type f | wc -l on the destination directory every 10 seconds, it shows that barely 2 or 3 new files are being added a minute. I look at modification times on files that gsutil says it's downloading right now and in the large majority they're old, plenty haven't changed in a year or more. Meaning: it's downloading all the data, using tons of time and bandwidth, all for the sake of a few hundred files.
 
Has something changed in recent OSX gsutil versions? Is there possibly a bug? How would I even start to go about tracking this down? Or reporting it? The newsgroups gsutil-discuss and gs-discussion have been archived, and the talk in gce-discussion is all about using gsutil from GCE instances.
 
Thanks!

原文：https://stackoverflow.com/questions/39016621