io-uring: add napi busy poll support
This adds the napi busy polling support in io_uring.c. It adds a new napi_list to the io_ring_ctx structure. This list contains the list of napi_id's that are currently enabled for busy polling. The list is synchronized by the new napi_lock spin lock. The current default napi busy polling time is stored in napi_busy_poll_to. If napi busy polling is not enabled, the value is 0. In addition there is also a hash table. The hash table store the napi id and the pointer to the above list nodes. The hash table is used to speed up the lookup to the list elements. The hash table is synchronized with rcu. The NAPI_TIMEOUT is stored as a timeout to make sure that the time a napi entry is stored in the napi list is limited. The busy poll timeout is also stored as part of the io_wait_queue. This is necessary as for sq polling the poll interval needs to be adjusted and the napi callback allows only to pass in one value. This has been tested with two simple programs from the libu...
Showing
- include/linux/io_uring_types.h 14 additions, 1 deletioninclude/linux/io_uring_types.h
- io_uring/Makefile 1 addition, 0 deletionsio_uring/Makefile
- io_uring/io_uring.c 8 additions, 0 deletionsio_uring/io_uring.c
- io_uring/io_uring.h 4 additions, 0 deletionsio_uring/io_uring.h
- io_uring/napi.c 255 additions, 0 deletionsio_uring/napi.c
- io_uring/napi.h 89 additions, 0 deletionsio_uring/napi.h
- io_uring/poll.c 2 additions, 0 deletionsio_uring/poll.c
Please register or sign in to comment