首页 \ 问答 \ 协调多个并发队列(Coordinating multiple concurrent queues)

协调多个并发队列(Coordinating multiple concurrent queues)

我目前有一个并发队列实现,它使用BlockingQueue作为数据存储。 我现在需要引入具有更高优先级的第二类对象,使我朝向原始队列的饥饿/优先级队列。 所以我们正在处理类型为A的对象,而B类是从多个线程生成的。 B类型的任何对象都应该在类型A的对象之前处理,但除了必须保持FIFO顺序之外。 因此,如果插入{1A,1B,2A,3A,2B},则顺序应为{1B,2B,1A,2A,3A}

我尝试了一个PriorityBlockingQueue将类型B推到前面,但我无法维持FIFO要求(相同类型的项之间没有自然顺序)。

我的下一个想法是使用两个并发队列。 在协调两个队列之间的访问时,我正在寻找常见的问题或考虑因素。 理想情况下,我想做这样的事情:

   public void add(A a)
   {
       aQueue.add(a);
   }
   public void add(B b)
   {
       bQueue.add(b);
   }

   private void consume() 
   {
       if(!bQueue.isEmpty())
          process(bQueue.poll());
       else if(!aQueue.isEmpty())
          process(aQueue.poll());
   }

如果两个队列都是ConcurrentLinkedQueue (或在此处插入更合适的结构),我是否需要任何同步或锁定? 注意我有很多生产者,但只有一个消费者(单线程ThreadPoolExecutor )。

编辑:如果一个B在isEmpty()检查后进入,则可以处理A并在下一个consume()调用时处理它。


I currently have a concurrent queue implementation that uses a BlockingQueue as the data store. I now need to introduce a second type of object that has a higher priority, leading me towards a starvation/priority queue for the original queue. So we're working with objects of type A and type B being produced from multiple threads. Any objects of type B should be processed before those of type A, but other than that FIFO order MUST be maintained. So if { 1A, 1B, 2A, 3A, 2B } are inserted the order should be {1B, 2B, 1A, 2A, 3A}

I tried a single PriorityBlockingQueue to push type Bs to the front, but I couldn't maintain the FIFO requirement (there's no natural order between items of the same type).

My next thought is to use two concurrent queues. I'm looking for common gotchas or considerations when coordinating access between the two queues. Ideally, I'd want to do something like this:

   public void add(A a)
   {
       aQueue.add(a);
   }
   public void add(B b)
   {
       bQueue.add(b);
   }

   private void consume() 
   {
       if(!bQueue.isEmpty())
          process(bQueue.poll());
       else if(!aQueue.isEmpty())
          process(aQueue.poll());
   }

Would I need any synchronization or locks if both queues are ConcurrentLinkedQueue (or insert more appropriate structure here)? Note I have many producers, but only one consumer (single threaded ThreadPoolExecutor).

EDIT: If a B comes in after the isEmpty() check, it's ok to process an A and handle it on the next consume() call.


原文:https://stackoverflow.com/questions/4617356
更新时间:2024-02-07 09:02

相关文章

更多

最新问答

更多
  • 获取MVC 4使用的DisplayMode后缀(Get the DisplayMode Suffix being used by MVC 4)
  • 如何通过引用返回对象?(How is returning an object by reference possible?)
  • 矩阵如何存储在内存中?(How are matrices stored in memory?)
  • 每个请求的Java新会话?(Java New Session For Each Request?)
  • css:浮动div中重叠的标题h1(css: overlapping headlines h1 in floated divs)
  • 无论图像如何,Caffe预测同一类(Caffe predicts same class regardless of image)
  • xcode语法颜色编码解释?(xcode syntax color coding explained?)
  • 在Access 2010 Runtime中使用Office 2000校对工具(Use Office 2000 proofing tools in Access 2010 Runtime)
  • 从单独的Web主机将图像传输到服务器上(Getting images onto server from separate web host)
  • 从旧版本复制文件并保留它们(旧/新版本)(Copy a file from old revision and keep both of them (old / new revision))
  • 西安哪有PLC可控制编程的培训
  • 在Entity Framework中选择基类(Select base class in Entity Framework)
  • 在Android中出现错误“数据集和渲染器应该不为null,并且应该具有相同数量的系列”(Error “Dataset and renderer should be not null and should have the same number of series” in Android)
  • 电脑二级VF有什么用
  • Datamapper Ruby如何添加Hook方法(Datamapper Ruby How to add Hook Method)
  • 金华英语角.
  • 手机软件如何制作
  • 用于Android webview中图像保存的上下文菜单(Context Menu for Image Saving in an Android webview)
  • 注意:未定义的偏移量:PHP(Notice: Undefined offset: PHP)
  • 如何读R中的大数据集[复制](How to read large dataset in R [duplicate])
  • Unity 5 Heighmap与地形宽度/地形长度的分辨率关系?(Unity 5 Heighmap Resolution relationship to terrain width / terrain length?)
  • 如何通知PipedOutputStream线程写入最后一个字节的PipedInputStream线程?(How to notify PipedInputStream thread that PipedOutputStream thread has written last byte?)
  • python的访问器方法有哪些
  • DeviceNetworkInformation:哪个是哪个?(DeviceNetworkInformation: Which is which?)
  • 在Ruby中对组合进行排序(Sorting a combination in Ruby)
  • 网站开发的流程?
  • 使用Zend Framework 2中的JOIN sql检索数据(Retrieve data using JOIN sql in Zend Framework 2)
  • 条带格式类型格式模式编号无法正常工作(Stripes format type format pattern number not working properly)
  • 透明度错误IE11(Transparency bug IE11)
  • linux的基本操作命令。。。