并行编程发生在代码同时被执行并且每次执行都是相互独立的时候。因此，通常不会有关于共享变量之类的关注，因为那不太可能发生。

However, concurrent programming consists on code being executed by different processes/threads that share variables and such, therefore on concurrent programming we must establish some sort of rule to decide which process/thread executes first, we want this so that we can be sure there will be consistency and that we can know with certainty what will happen. If there is no control and all threads compute at the same time and store things on the same variables, how would we know what to expect in the end? Maybe a thread is faster than the other, maybe one of the threads even stopped in the middle of its execution and another continued a different computation with a corrupted (not yet fully computed) variable, the possibilities are endless. It's in these situations that we usually use concurrent programming instead of parallel.

将原始问题解释为并行/并发计算，而不是编程。

在并发计算中，两个计算都是彼此独立前进的。第二个计算不需要等到第一个计算完成后才能继续进行。但是，它并没有说明这是如何实现的机制。在单核设置中，线程之间需要挂起和交替(也称为抢占式多线程)。

在并行计算中，两个计算同时进行——字面上是同时进行。这对于单CPU来说是不可能的，而是需要多核设置。

图片来自文章:“Node.js中的并行vs并发”

与

并行编程发生在代码同时被执行并且每次执行都是相互独立的时候。因此，通常不会有关于共享变量之类的关注，因为那不太可能发生。

However, concurrent programming consists on code being executed by different processes/threads that share variables and such, therefore on concurrent programming we must establish some sort of rule to decide which process/thread executes first, we want this so that we can be sure there will be consistency and that we can know with certainty what will happen. If there is no control and all threads compute at the same time and store things on the same variables, how would we know what to expect in the end? Maybe a thread is faster than the other, maybe one of the threads even stopped in the middle of its execution and another continued a different computation with a corrupted (not yet fully computed) variable, the possibilities are endless. It's in these situations that we usually use concurrent programming instead of parallel.

从处理器的角度来看，它可以用这张图片来描述

从处理器的角度来看，它可以用这张图片来描述

虽然没有完整 对并行和并发这两个术语的区别达成一致， 许多作者做了以下区分:

在并发计算中，一个程序可以在任意时刻执行多个任务。 在并行计算中，一个程序是多个任务紧密合作的程序 解决一个问题。

所以并行程序是并发的，但是像多任务操作系统这样的程序也是并发的，即使它运行在一台带有 只有一个核心，因为多个任务可以在任何时刻进行。

来源:Peter Pacheco的《并行编程介绍》

并发性和并行性源

在单个处理器上的多线程进程中，处理器可以在线程之间切换执行资源，从而实现并发执行。

在共享内存多处理器环境中的同一个多线程进程中，进程中的每个线程可以同时在单独的处理器上运行，从而导致并行执行。

当进程的线程数量与处理器数量相同或较少时，线程支持系统结合操作环境确保每个线程运行在不同的处理器上。

例如，在具有相同数量的线程和处理器的矩阵乘法中，每个线程(和每个处理器)计算结果的一行。