Python 并行编程

分手后的思念是犯贱 2022-12-20 11:22 253阅读 0赞

参考：python-parallel-programming-cookbook-cn：[https://python-parallel-programmning-cookbook.readthedocs.io/zh\_CN/latest/][https_python-parallel-programmning-cookbook.readthedocs.io_zh_CN_latest]

![watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2ZyZWVraW5nMTAx_size_16_color_FFFFFF_t_70][]

# [第一章 认识并行计算和Python][_Python] #

*  [1. 介绍][1.]
 *  [2. 并行计算的内存架构][2.]
 *  [3. 内存管理][3.]
 *  [4. 并行编程模型][4.]
 *  [5. 如何设计一个并行程序][5.]
 *  [6. 如何评估并行程序的性能][6.]
 *  [7. 介绍Python][7. _Python]
 *  [8. 并行世界的Python][8. _Python]
 *  [9. 介绍线程和进程][9.]
 *  [10. 开始在Python中使用进程][10. _Python]
 *  [11. 开始在Python中使用线程][11. _Python]

# [第二章 基于线程的并行][Link 1] #

*  [1. 介绍][1. 1]
 *  [2. 使用Python的线程模块][2. _Python]
 *  [3. 如何定义一个线程][3. 1]
 *  [4. 如何确定当前的线程][4. 1]
 *  [5. 如何实现一个线程][5. 1]
 *  [6. 使用Lock进行线程同步][6. _Lock]
 *  [7. 使用RLock进行线程同步][7. _RLock]
 *  [8. 使用信号量进行线程同步][8.]
 *  [9. 使用条件进行线程同步][9. 1]
 *  [10. 使用事件进行线程同步][10.]
 *  [11. 使用with语法][11. _with]
 *  [12. 使用 `queue` 进行线程通信][12. _queue]
 *  [13. 评估多线程应用的性能][13.]

# [第三章 基于进程的并行][Link 2] #

*  [1. 介绍][1. 2]
 *  [2. 如何产生一个进程][2. 1]
 *  [3. 如何为一个进程命名][3. 2]
 *  [4. 如何在后台运行一个进程][4. 2]
 *  [5. 如何杀掉一个进程][5. 2]
 *  [6. 如何在子类中使用进程][6. 1]
 *  [7. 如何在进程之间交换对象][7.]
 *  [8. 进程如何同步][8. 1]
 *  [9. 如何在进程之间管理状态][9. 2]
 *  [10. 如何使用进程池][10. 1]
 *  [11. 使用Python的mpi4py模块][11. _Python_mpi4py]
 *  [12. 点对点通讯][12.]
 *  [13. 避免死锁问题][13. 1]
 *  [14. 集体通讯：使用broadcast通讯][14. _broadcast]
 *  [15. 集体通讯：使用scatter通讯][15. _scatter]
 *  [16. 集体通讯：使用gather通讯][16. _gather]
 *  [17. 使用Alltoall通讯][17. _Alltoall]
 *  [18. 简化操作][18.]
 *  [19. 如何优化通讯][19.]

# [第四章 异步编程][Link 3] #

*  [1. 介绍][1. 3]
 *  [2. 使用Python的 `concurrent.futures` 模块][2. _Python_concurrent.futures]
 *  [3. 使用Asyncio管理事件循环][3. _Asyncio]
 *  [4. 使用Asyncio管理协程][4. _Asyncio]
 *  [5. 使用Asyncio控制任务][5. _Asyncio]
 *  [6. 使用Asyncio和Futures][6. _Asyncio_Futures]

# [第五章 分布式Python编程][_Python 1] #

*  [1. 介绍][1. 4]
 *  [2. 使用Celery实现分布式任务][2. _Celery]
 *  [3. 如何使用Celery创建任务][3. _Celery]
 *  [4. 使用SCOOP进行科学计算][4. _SCOOP]
 *  [5. 通过 SCOOP 使用 map 函数][5. _ SCOOP _ map]
 *  [6. 使用Pyro4进行远程方法调用][6. _Pyro4]
 *  [7. 使用 Pyro4 链接对象][7. _ Pyro4]
 *  [8. 使用Pyro4部署客户端-服务器应用][8. _Pyro4_-]
 *  [9. PyCSP和通信顺序进程][9. PyCSP]
 *  [10. 使用Disco进行MapReduce][10. _Disco_MapReduce]
 *  [11. 使用RPyC远程调用][11. _RPyC]

# [第六章 Python GPU编程][Python GPU] #

*  [1. 介绍][1. 5]
 *  [2. 使用PyCUDA模块][2. _PyCUDA]
 *  [3. 如何创建一个PyCUDA应用][3. _PyCUDA]
 *  [4. 理解PyCuDA内存模型][4. _PyCuDA]
 *  [5. 使用GPUArray进行内核调用][5. _GPUArray]
 *  [6. 使用PyCUDA评估元素][6. _PyCUDA]
 *  [7. 使用PyCUDA进行MapReduce操作][7. _PyCUDA_MapReduce]
 *  [8. 使用NumbaPro进行GPU编程][8. _NumbaPro_GPU]
 *  [9. 使用GPU加速的库][9. _GPU]
 *  [10. 使用PyOpenCL模块][10. _PyOpenCL]
 *  [11. 如何创建一个PyOpenCL应用][11. _PyOpenCL]
 *  [12. 使用PyOpenCL评估元素][12. _PyOpenCL]
 *  [13. 使用PyOpenCL测试你的GPU应用][13. _PyOpenCL_GPU]

[https_python-parallel-programmning-cookbook.readthedocs.io_zh_CN_latest]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/
[watermark_type_ZmFuZ3poZW5naGVpdGk_shadow_10_text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L2ZyZWVraW5nMTAx_size_16_color_FFFFFF_t_70]: /images/20221120/926bae6f5049415c89c2278bbd487966.png
[_Python]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter1/index.html
[1.]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter1/01_Introduction.html
[2.]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter1/02_The-parallel-computing-memory-architecture.html
[3.]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter1/03_Memory_organization.html
[4.]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter1/04_Parallel_programming_models.html
[5.]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter1/05_How_to_design_a_parallel_program.html
[6.]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter1/06_How_to_evaluate_the_performance_of_a_parallel_program.html
[7. _Python]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter1/07_Introducing_Python.html
[8. _Python]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter1/08_Python_in_a_parallel_world.html
[9.]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter1/09_Introducing_process_and_threads.html
[10. _Python]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter1/10_Start_working_with_processes_in_Python.html
[11. _Python]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter1/11_Start_working_with_threads_in_Python.html
[Link 1]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter2/index.html
[1. 1]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter2/01_Introduction.html
[2. _Python]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter2/02_Using_the_Python_threading_module.html
[3. 1]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter2/03_how_to_define_a_thread.html
[4. 1]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter2/04_How_to_determine_the_current_thread.html
[5. 1]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter2/05_How_to_use_a_thread_in_a_subclass.html
[6. _Lock]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter2/06_Thread_synchronization_with_Lock_and_Rlock.html
[7. _RLock]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter2/07_Thread_synchronization_with_RLock.html
[8.]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter2/08_Thread_synchronization_with_semaphores.html
[9. 1]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter2/09_Thread_synchronization_with_a_condition.html
[10.]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter2/10_Thread_synchronization_with_an_event.html
[11. _with]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter2/11_Using_the_with_statement.html
[12. _queue]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter2/12_Thread_communication_using_a_queue.html
[13.]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter2/13_Evaluating_the_performance_of_multithread_applications.html
[Link 2]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter3/index.html
[1. 2]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter3/01_Introduction.html
[2. 1]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter3/02_How_to_spawn_a_process.html
[3. 2]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter3/03_How_to_name_a_process.html
[4. 2]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter3/04_How_to_run_a_process_in_the_background.html
[5. 2]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter3/05_How_to_kill_a_process.html
[6. 1]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter3/06_How_to_use_a_process_in_a_subclass.html
[7.]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter3/07_How_to_exchange_objects_between_processes.html
[8. 1]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter3/08_How_to_synchronize_processes.html
[9. 2]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter3/09_How_to_manage_a_state_between_processes.html
[10. 1]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter3/10_How_to_use_a_process_pool.html
[11. _Python_mpi4py]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter3/11_Using_the_mpipy_Python_module.html
[12.]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter3/12_Point-to-point_communication.html
[13. 1]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter3/13_Avoiding_deadlock_problems.html
[14. _broadcast]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter3/14_Collective_communication_using_broadcast.html
[15. _scatter]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter3/15_Collective_communication_using_scatter.html
[16. _gather]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter3/16_Collective_communication_using_gather.html
[17. _Alltoall]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter3/17_Collective_communication_using_Alltoall.html
[18.]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter3/18_The_reduction_operation.html
[19.]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter3/19_How_to_optimize_communication.html
[Link 3]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter4/index.html
[1. 3]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter4/01_Introduction.html
[2. _Python_concurrent.futures]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter4/02_Using_the_concurrent.futures_Python_modules.html
[3. _Asyncio]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter4/03_Event_loop_management_with_Asyncio.html
[4. _Asyncio]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter4/04_Handing_corotines_with_Asyncio.html
[5. _Asyncio]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter4/05_Task_manipulation_with_Asyncio.html
[6. _Asyncio_Futures]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter4/06_Dealing_with_Asyncio_and_Futures.html
[_Python 1]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter5/index.html
[1. 4]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter5/01_Introduction.html
[2. _Celery]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter5/02_Using_Celery_to_distribute_tasks.html
[3. _Celery]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter5/03_How_to_create_a_task_with_Celery.html
[4. _SCOOP]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter5/04_Scientic_computing_with_SCOOP.html
[5. _ SCOOP _ map]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter5/05_Handling_map_functions_with_SCOOP.html
[6. _Pyro4]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter5/06_Remote_Method_Invocation_with_Pyro4.html
[7. _ Pyro4]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter5/07_Chaining_objects_with_Pyro4.html
[8. _Pyro4_-]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter5/08_Developing_a_client-server_application_with_Pyro4.html
[9. PyCSP]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter5/09_Communicating_sequential_processes_with_PyCSP.html
[10. _Disco_MapReduce]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter5/10_Using_MapReduce_with_Disco.html
[11. _RPyC]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter5/11_A_remote_procedure_call_with_RPyC.html
[Python GPU]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter6/index.html
[1. 5]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter6/01_Introduction.html
[2. _PyCUDA]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter6/02_Using_the_PyCUDA_module.html
[3. _PyCUDA]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter6/03_How_to_build_a_PyCUDA_application.html
[4. _PyCuDA]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter6/04_Understanding_the_PyCUDA_memory_model_with_matrix_manipulation.html
[5. _GPUArray]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter6/05_Kernel_invocations_with_GPUArray.html
[6. _PyCUDA]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter6/06_Evaluating_element-wise_expressions_with_PyCUDA.html
[7. _PyCUDA_MapReduce]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter6/07_The_MapReduce_operation_with_PyCUDA.html
[8. _NumbaPro_GPU]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter6/08_GPU_programming_with_NumbaPro.html
[9. _GPU]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter6/09_Using_GPU-accelerated_libraries_with_NumbaPro.html
[10. _PyOpenCL]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter6/10_Using_the_PyOpenCL_module.html
[11. _PyOpenCL]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter6/11_How_to_build_a_PyOpenCL_application.html
[12. _PyOpenCL]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter6/12_Evaluating_element-wise_expressions_with_PyOpenCl.html
[13. _PyOpenCL_GPU]: https://python-parallel-programmning-cookbook.readthedocs.io/zh_CN/latest/chapter6/13_Testing_your_GPU_application_with_PyOpenCL.html

发表评论取消回复

表情：

评论列表（有 0 条评论，253人围观）

还没有评论，来说两句吧...

相关阅读

相关使用set数据结构理解Python并行编程

在理解和使用Python的并行编程时，Set数据结构是一个非常重要的工具。以下是如何通过使用Set来理解并行编程的几个方面： 1. **任务分发**：在并行编程中，任

蔚落/ 2025年01月26日 19:00/ 0 赞/ 14 阅读

相关 Python并行编程常见问题及解决方案实例

在Python的并行编程中，常见的问题和对应的解决方案包括： 1. **资源利用率低**：如果任务本身耗时长且计算密集型，可能导致所有进程都在等待。 - 解决方案：使

绝地灬酷狼/ 2025年01月06日 10:48/ 0 赞/ 43 阅读

相关 Python并行编程：使用multiprocessing库的案例分享

`multiprocessing`是Python标准库中的一个子模块，它提供了多进程处理的能力。下面我将通过几个实际案例来说明如何使用`multiprocessing`。 1

小咪咪/ 2025年01月04日 13:48/ 0 赞/ 33 阅读

相关 C# 并行编程 Task

1. 创建Task 创建Task的方法有两种，一种是直接创建——new一个出来，一种是通过工厂创建。 //第一种创建方式，直接实例化 va

深藏阁楼爱情的钟/ 2023年08月17日 17:23/ 0 赞/ 149 阅读

相关 Python3 系列之并行编程

进程和线程进程是程序运行的实例。一个进程里面可以包含多个线程，因此同一进程下的多个线程之间可以共享线程内的所有资源，它是操作系统动态运行的基本单元；每一个线程是进程下的

布满荆棘的人生/ 2023年08月17日 15:35/ 0 赞/ 156 阅读

相关 Python 并行编程

参考：python-parallel-programming-cookbook-cn：[https://python-parallel-programmning-cook

分手后的思念是犯贱/ 2022年12月20日 11:22/ 0 赞/ 254 阅读

相关并行编程——并发级别

1.1 Wait-freedom 无等待并发 Wait-freedom 指的是每一个线程都一直运行下去而无须等待外部条件，整个流程中任何操作都能在一个有限的步骤内完成，这是最

待我称王封你为后i/ 2022年07月13日 06:50/ 0 赞/ 275 阅读

相关 java并行化编程

说明在写算法时，经常会想并行化一些没有关联的步骤，其原因会减少算法的运行时间，最近再搞算法编程的时候，就遇到这种问题。这里提供一种简单的，并行化java编程。 co

水深无声/ 2022年05月28日 10:06/ 0 赞/ 278 阅读

相关并行编程——并发级别

在看多核编程相关论文时，往往一个并发算法会说自己是wait-free的或者lock-free的，或者是 non-blocking 的，这些专有词汇其实表示的是并发的程度，或者说

灰太狼/ 2022年04月21日 16:06/ 0 赞/ 250 阅读

相关 openMP 并行编程

[OpenMP 入门教程][OpenMP]： [https://www.cnblogs.com/ospider/p/5265975.html][OpenMP] [op

港控/mmm°/ 2022年03月29日 13:44/ 0 赞/ 259 阅读