Python多进程同步Lock、Semaphore、Event实例
作者:junjie 时间:2021-02-22 17:11:26
同步的方法基本与多线程相同。
1) Lock
当多个进程需要访问共享资源的时候,Lock可以用来避免访问的冲突。
import multiprocessing
import sys
def worker_with(lock, f):
with lock:
fs = open(f,"a+")
fs.write('Lock acquired via with\n')
fs.close()
def worker_no_with(lock, f):
lock.acquire()
try:
fs = open(f,"a+")
fs.write('Lock acquired directly\n')
fs.close()
finally:
lock.release()
if __name__ == "__main__":
f = "file.txt"
lock = multiprocessing.Lock()
w = multiprocessing.Process(target=worker_with, args=(lock, f))
nw = multiprocessing.Process(target=worker_no_with, args=(lock, f))
w.start()
nw.start()
w.join()
nw.join()
在上面的例子中,如果两个进程没有使用lock来同步,则他们对同一个文件的写操作可能会出现混乱。
2)Semaphore
Semaphore用来控制对共享资源的访问数量,例如池的最大连接数。
import multiprocessing
import time
def worker(s,i):
s.acquire()
print(multiprocessing.current_process().name + " acquire")
time.sleep(i)
print(multiprocessing.current_process().name + " release")
s.release()
if __name__ == "__main__":
s = multiprocessing.Semaphore(2)
for i in range(5):
p = multiprocessing.Process(target=worker, args=(s,i*2))
p.start()
上面的实例中使用semaphore限制了最多有2个进程同时执行。
3)Event
Event用来实现进程间同步通信。
import multiprocessing
import time
def wait_for_event(e):
"""Wait for the event to be set before doing anything"""
print ('wait_for_event: starting')
e.wait()
print ('wait_for_event: e.is_set()->' + str(e.is_set()))
def wait_for_event_timeout(e, t):
"""Wait t seconds and then timeout"""
print ('wait_for_event_timeout: starting')
e.wait(t)
print ('wait_for_event_timeout: e.is_set()->' + str(e.is_set()))
if __name__ == '__main__':
e = multiprocessing.Event()
w1 = multiprocessing.Process(name='block',
target=wait_for_event,
args=(e,))
w1.start()
w2 = multiprocessing.Process(name='non-block',
target=wait_for_event_timeout,
args=(e, 2))
w2.start()
time.sleep(3)
e.set()
print ('main: event is set')
#the output is:
#wait_for_event_timeout: starting
#wait_for_event: starting
#wait_for_event_timeout: e.is_set()->False
#main: event is set
#wait_for_event: e.is_set()->True
![](/images/zang.png)
![](/images/jiucuo.png)
猜你喜欢
Python利用PyExecJS库执行JS函数的案例分析
![](https://img.aspxhome.com/file/2023/4/94154_0s.jpg)
Python中的类对象示例详解
python下10个简单实例代码
php之redis短线重连案例讲解
python实现DNS正向查询、反向查询的例子
Python Pandas数据合并pd.merge用法详解
![](https://img.aspxhome.com/file/2023/5/93495_0s.png)
OpenCV图像变换之傅里叶变换的一些应用
![](https://img.aspxhome.com/file/2023/9/85359_0s.jpg)
Jupyter Notebook的连接密码 token查询方式
![](https://img.aspxhome.com/file/2023/9/101339_0s.jpg)
Python基于SMTP协议实现发送邮件功能详解
![](https://img.aspxhome.com/file/2023/8/72838_0s.png)
详解Django中CSRF和CORS的区别
![](https://img.aspxhome.com/file/2023/1/78741_0s.jpg)
浏览器tab的设计
![](https://img.aspxhome.com/file/UploadPic/20088/11/200881113621228s.jpg)
Numpy中创建数组的9种方式小结
![](https://img.aspxhome.com/file/2023/7/103247_0s.png)
Python绘制K线图之可视化神器pyecharts的使用
![](https://img.aspxhome.com/file/2023/5/95415_0s.png)
python命令行参数解析OptionParser类用法实例
![](https://img.aspxhome.com/file/2023/6/70736_0s.gif)
Python字典生成式、集合生成式、生成器用法实例分析
Pytorch平均池化nn.AvgPool2d()使用方法实例
![](https://img.aspxhome.com/file/2023/1/104921_0s.png)
Python如何快速上手? 快速掌握一门新语言的方法
屏蔽Flash 右键菜单的方法
页面设计之个性元素与共性元素
![](https://img.aspxhome.com/file/UploadPic/20087/17/200871712436841s.jpg)