Use PriorityQueue internally in PythonCANSockets (#3061)

* This PR adds a priority queue on python-can sockets to ensure the right order of packets.
Incorrect order of CAN packets in PythonCANSockets are a long existing
bug in Scapy and probably the reason for most instability in Unit Tests.

This PR consists of the following changes:
	* Use PriorityQueue in python_can Socket Multiplexers
	* Introduce prio counter to not have message inversion on identical time stamps
	* enable isotp.uts on non root CI systems to check stability of change
	* add additional unit test

* Enable unstable isotpscan tests to see if this PR has an effect on them

* Validate if PriorityQueue is causing the stability I'm seeing in the tests

* Validate again. This time remove prio code which shouldn't had any effect

* Revert "Validate again. This time remove prio code which shouldn't had any effect"

This reverts commit bd1d868d0277b7ae43a785c23ebd6e27b3d1b753.

* Revert "Validate if PriorityQueue is causing the stability I'm seeing in the tests"

This reverts commit a25c579d0d6b6d99b53a3670ca8d0d8a07f13fbf.

* disable some long tests

* fix rebase bug

* minor addition to __lt__ operator

* Add a comment why priority is necessary

* fix unit test
4 files changed
tree: 4e1ed93322c60cdc7a28cb020ffbc06b2b6f1317
  1. .config/
  2. .github/
  3. doc/
  4. scapy/
  5. test/
  6. .appveyor.yml
  7. .gitattributes
  8. .gitignore
  9. .readthedocs.yml
  10. .travis.yml
  11. CONTRIBUTING.md
  12. LICENSE
  13. MANIFEST.in
  14. README.md
  15. run_scapy
  16. run_scapy.bat
  17. setup.cfg
  18. setup.py
  19. tox.ini
README.md

Scapy

Scapy unit tests AppVeyor Build status Codecov Status Codacy Badge PyPI Version Python Versions License: GPL v2 Join the chat at https://gitter.im/secdev/scapy

Scapy is a powerful Python-based interactive packet manipulation program and library.

It is able to forge or decode packets of a wide number of protocols, send them on the wire, capture them, store or read them using pcap files, match requests and replies, and much more. It is designed to allow fast packet prototyping by using default values that work.

It can easily handle most classical tasks like scanning, tracerouting, probing, unit tests, attacks or network discovery (it can replace hping, 85% of nmap, arpspoof, arp-sk, arping, tcpdump, wireshark, p0f, etc.). It also performs very well at a lot of other specific tasks that most other tools can't handle, like sending invalid frames, injecting your own 802.11 frames, combining techniques (VLAN hopping+ARP cache poisoning, VoIP decoding on WEP protected channel, ...), etc.

Scapy supports Python 2.7 and Python 3 (3.4 to 3.8). It's intended to be cross platform, and runs on many different platforms (Linux, OSX, *BSD, and Windows).

Getting started

Scapy is usable either as a shell or as a library. For further details, please head over to Getting started with Scapy, which is part of the documentation.

Shell demo

Scapy install demo

Scapy can easily be used as an interactive shell to interact with the network. The following example shows how to send an ICMP Echo Request message to github.com, then display the reply source IP address:

sudo ./run_scapy
Welcome to Scapy
>>> p = IP(dst="github.com")/ICMP()
>>> r = sr1(p)
Begin emission:
.Finished to send 1 packets.
*
Received 2 packets, got 1 answers, remaining 0 packets
>>> r[IP].src
'192.30.253.113'

Resources

The documentation contains more advanced use cases, and examples.

Other useful resources:

Installation

Scapy works without any external Python modules on Linux and BSD like operating systems. On Windows, you need to install some mandatory dependencies as described in the documentation.

On most systems, using Scapy is as simple as running the following commands:

git clone https://github.com/secdev/scapy
cd scapy
./run_scapy

To benefit from all Scapy features, such as plotting, you might want to install Python modules, such as matplotlib or cryptography. See the documentation and follow the instructions to install them.

Contributing

Want to contribute? Great! Please take a few minutes to read this!