Syncing latest libbpf commits from kernel repository.
Baseline bpf-next commit: 9a3a07d06e7d74f4aecc51396c771149336ac55d
Checkpoint bpf-next commit: b5a4aa31abd6fe90009b63e35dc18c67d041ec0c
Baseline bpf commit: 7cbd0c4cebe4c9f678d15e6b9ba975e1155a107f
Checkpoint bpf commit: de020dc8049bfb2b22e3b6d99c031feb2e22d112
Alan Maguire (2):
btf: Extend UAPI to support BTF location (inline site) info
libbpf: Add support for BTF kinds LOC[_PARAM|_PROTO|SEC]
Alexei Starovoitov (4):
libbpf: Support pointers to static functions in data when linking
libbpf: Resolve pointers to functions in read-only data
libbpf: Treat .data.rel.ro as read-only data
libbpf: Support pointers to functions in read-only data in light
skeleton
Amery Hung (1):
bpf: tcp: Support parse/len/write header option hooks in bpf_tcp_ops
Andrii Nakryiko (1):
libbpf: Fix static linking of externs placed in allocated sections
Avinash Duduskar (2):
bpf: Add BPF_FIB_LOOKUP_VLAN flag to bpf_fib_lookup() helper
bpf: Add BPF_FIB_LOOKUP_VLAN_INPUT flag to bpf_fib_lookup() helper
Bobby Eshleman (1):
net: devmem: allow rx-page-size > PAGE_SIZE per dmabuf binding
Christian Brauner (1):
fs: support FD_FAILFS_ROOT in fchdir()
Darren Carreras (1):
libbpf: Avoid overflow in BTF.ext bounds check
Fuyu Zhao (1):
libbpf: Support selective kernel module BTF loading via
bpf_object_open_opts
Ihor Solodrai (3):
libbpf: Export btf__find_by_name_kind_own()
libbpf: Walk types in btf_dump_resize(), not in mark_referenced()
libbpf: Render decl_tags in btf_dump
Israel Téllez García (1):
libbpf: Fix ring buffer consumer loop on 32-bit position wrap
Jianlin Shi (1):
docs: bpf: Document BPF_RB_OVERWRITE_POS in bpf_ringbuf_query
Jiayuan Chen (1):
libbpf: Fix usdt attach failure when nop10 crosses page boundary
Jiri Olsa (2):
libbpf: Change has_nop_combo to work on top of nop10
libbpf: Detect uprobe syscall with new error
Kumar Kartikeya Dwivedi (4):
bpf: Restrict CO-RE poisoning to relocatable instructions
libbpf: Reject truncated ldimm64 CO-RE relocations
bpf: Add file descriptor interface for program streams
libbpf: Add bpf_prog_stream_open()
Leon Hwang (5):
libbpf: Probe percpu data feature
libbpf: Add support for global percpu data
bpftool: Generate skeleton for global percpu data
libbpf: Avoid unnecessary mmap resize for percpu data maps
bpftool: Compute map size of light skeletons at runtime
Luis Vieira (3):
libbpf: Fix program log buffer size validation
libbpf: Validate ELF symbol table entry size
libbpf: Fix cleanup on invalid CO-RE relocation offsets
Mahe Tardy (1):
libbpf: fix log level propagation for light skeleton loaders
Martin KaFai Lau (2):
bpf: Add infrastructure to support attaching struct_ops to cgroups
libbpf: Support attaching struct_ops to a cgroup
Mingpei CAO (2):
libbpf: Fix array comparison in BTF dedup
libbpf: Reject local struct_ops bitfields before data access
Mykyta Yatsenko (1):
libbpf: Defer arena map size check to load time
Nick Hudson (2):
bpf: Name the enum for BPF_FUNC_skb_adjust_room flags
bpf: Add BPF_F_ADJ_ROOM_DECAP_* flags for tunnel decapsulation
Puranjay Mohan (1):
bpf: Add bpf_call_rcu() kfunc
Ricardo B. Marlière (1):
libbpf: Search /lib64 and /lib in resolve_full_path()
Stanislav Fomichev (1):
xsk: align TX metadata layout across ABIs
Sudip Mukherjee (1):
libbpf: Fix debian kernel version information parsing
Toke Høiland-Jørgensen (2):
libbpf: Move section-defined program flags to prog_flags
libbpf: Add bpf_program__add_flags() and bpf_program__clear_flags()
Tw (1):
libbpf: Fix for the potential undefined behavior due to shifting
include/uapi/linux/bpf.h | 171 +++++++-
include/uapi/linux/btf.h | 83 +++-
include/uapi/linux/fcntl.h | 1 +
include/uapi/linux/if_xdp.h | 1 +
include/uapi/linux/netdev.h | 1 +
src/bpf.c | 21 +
src/bpf.h | 27 +-
src/bpf_gen_internal.h | 16 +-
src/btf.c | 424 +++++++++++++++++++-
src/btf.h | 52 +++
src/btf_dump.c | 217 +++++++---
src/btf_iter.c | 18 +
src/elf.c | 2 +-
src/features.c | 39 +-
src/gen_loader.c | 175 ++++++--
src/libbpf.c | 772 +++++++++++++++++++++++++++++++++---
src/libbpf.h | 41 +-
src/libbpf.map | 11 +
src/libbpf_internal.h | 10 +-
src/libbpf_probes.c | 11 +-
src/linker.c | 31 +-
src/relo_core.c | 58 +--
src/ringbuf.c | 2 +-
src/skel_internal.h | 64 ++-
src/usdt.c | 20 +-
25 files changed, 2017 insertions(+), 251 deletions(-)
Signed-off-by: Andrii Nakryiko <andrii@kernel.org>
libbpf

This is the official home of the libbpf library.
Please use this Github repository for building and packaging libbpf and when using it in your projects through Git submodule.
Libbpf authoritative source code is developed as part of bpf-next Linux source
tree under
tools/lib/bpf subdirectory and is periodically synced to Github. As such, all the
libbpf changes should be sent to BPF mailing list,
please don't open PRs here unless you are changing Github-specific parts of libbpf
(e.g., Github-specific Makefile).
Libbpf and general BPF usage questions
Libbpf documentation can be found here. It's an ongoing effort and has ways to go, but please take a look and consider contributing as well.
Please check out libbpf-bootstrap and the companion blog post for the examples of building BPF applications with libbpf. libbpf-tools are also a good source of the real-world libbpf-based tracing tools.
See also "BPF CO-RE reference guide" for the coverage of practical aspects of building BPF CO-RE applications and "BPF CO-RE" for general introduction into BPF portability issues and BPF CO-RE origins.
All general BPF questions, including kernel functionality, libbpf APIs and their application, should be sent to bpf@vger.kernel.org mailing list. You can subscribe to it here and search its archive here. Please search the archive before asking new questions. It very well might be that this was already addressed or answered before.
bpf@vger.kernel.org is monitored by many more people and they will happily try to help you with whatever issue you have. This repository's PRs and issues should be opened only for dealing with issues pertaining to specific way this libbpf mirror repo is set up and organized.
Building libbpf
libelf is an internal dependency of libbpf and thus it is required to link
against and must be installed on the system for applications to work.
pkg-config is used by default to find libelf, and the program called can be
overridden with PKG_CONFIG.
If using pkg-config at build time is not desired, it can be disabled by
setting NO_PKG_CONFIG=1 when calling make.
To build both static libbpf.a and shared libbpf.so:
$ cd src
$ make
To build only static libbpf.a library in directory build/ and install them together with libbpf headers in a staging directory root/:
$ cd src
$ mkdir build root
$ BUILD_STATIC_ONLY=y OBJDIR=build DESTDIR=root make install
To build both static libbpf.a and shared libbpf.so against a custom libelf dependency installed in /build/root/ and install them together with libbpf headers in a build directory /build/root/:
$ cd src
$ PKG_CONFIG_PATH=/build/root/lib64/pkgconfig DESTDIR=/build/root make install
BPF CO-RE (Compile Once – Run Everywhere)
Libbpf supports building BPF CO-RE-enabled applications, which, in contrast to BCC, do not require Clang/LLVM runtime being deployed to target servers and doesn't rely on kernel-devel headers being available.
It does rely on kernel to be built with BTF type information, though. Some major Linux distributions come with kernel BTF already built in:
- Fedora 31+
- RHEL 8.2+
- OpenSUSE Tumbleweed (in the next release, as of 2020-06-04)
- Arch Linux (from kernel 5.7.1.arch1-1)
- Manjaro (from kernel 5.4 if compiled after 2021-06-18)
- Ubuntu 20.10
- Debian 11 (amd64/arm64)
If your kernel doesn't come with BTF built-in, you'll need to build custom kernel. You'll need:
pahole1.16+ tool (part ofdwarvespackage), which performs DWARF to BTF conversion;- kernel built with
CONFIG_DEBUG_INFO_BTF=yoption; - you can check if your kernel has BTF built-in by looking for
/sys/kernel/btf/vmlinuxfile:
$ ls -la /sys/kernel/btf/vmlinux
-r--r--r--. 1 root root 3541561 Jun 2 18:16 /sys/kernel/btf/vmlinux
To develop and build BPF programs, you'll need Clang/LLVM 10+. The following distributions have Clang/LLVM 10+ packaged by default:
- Fedora 32+
- Ubuntu 20.04+
- Arch Linux
- Ubuntu 20.10 (LLVM 11)
- Debian 11 (LLVM 11)
- Alpine 3.13+
Otherwise, please make sure to update it on your system.
The following resources are useful to understand what BPF CO-RE is and how to use it:
- BPF CO-RE reference guide
- BPF Portability and CO-RE
- HOWTO: BCC to libbpf conversion
- libbpf-tools in BCC repo contain lots of real-world tools converted from BCC to BPF CO-RE. Consider converting some more to both contribute to the BPF community and gain some more experience with it.
Distributions
Distributions packaging libbpf from this mirror:
Benefits of packaging from the mirror over packaging from kernel sources:
- Consistent versioning across distributions.
- No ties to any specific kernel, transparent handling of older kernels. Libbpf is designed to be kernel-agnostic and work across multitude of kernel versions. It has built-in mechanisms to gracefully handle older kernels, that are missing some of the features, by working around or gracefully degrading functionality. Thus libbpf is not tied to a specific kernel version and can/should be packaged and versioned independently.
- Continuous integration testing via GitHub Actions.
- Static code analysis via LGTM and Coverity.
Package dependencies of libbpf, package names may vary across distros:
- zlib
- libelf
bpf-next to Github sync
All the gory details of syncing can be found in scripts/sync-kernel.sh
script. See SYNC.md for instruction.
Some header files in this repo (include/linux/*.h) are reduced versions of
their counterpart files at
bpf-next's
tools/include/linux/*.h to make compilation successful.
License
This work is dual-licensed under BSD 2-clause license and GNU LGPL v2.1 license. You can choose between one of them if you use this work.
SPDX-License-Identifier: BSD-2-Clause OR LGPL-2.1