llvm-project/lld
Jianzhou Zhao 11201315d5 Flush bitcode incrementally for LTO output
Bitcode writer does not flush buffer until the end by default. This is
fine to small bitcode files. When -flto,--plugin-opt=emit-llvm,-gmlt are
used, the final bitcode file is large, for example, >8G. Keeping all
data in memory consumes a lot of memory.

This change allows bitcode writer flush data to disk early when buffered
data size is above some threshold. This is only enabled when lld emits
LLVM bitcode.

One issue to address is backpatching bitcode: subblock length, function
body indexes, meta data indexes need to backfill. If buffer can be
flushed partially, we introduced raw_fd_stream that supports
read/seek/write, and enables backpatching bitcode flushed in disk.

Reviewed-by: tejohnson, MaskRay

Differential Revision: https://reviews.llvm.org/D86905
2020-09-17 03:32:31 +00:00
..
COFF [PDB] Drop LF_PRECOMP from debugTypes earlier 2020-09-15 18:50:37 -07:00
Common lld: link libatomic if needed for Timer 2020-08-21 17:47:55 -07:00
ELF Flush bitcode incrementally for LTO output 2020-09-17 03:32:31 +00:00
MachO [lld-macho][NFC] Define isHidden() in LinkEditSection 2020-08-27 17:44:18 -07:00
MinGW [LLD] [MinGW] Enable dynamicbase by default 2020-08-27 15:08:53 +03:00
cmake/modules lld: Let find_package(LLD) work 2020-05-14 09:59:53 -04:00
docs [ELF] Add documentation for --warn-backrefs: a GNU ld compatibility checking tool (and lesser of layering detection) 2020-09-14 12:31:22 -07:00
include/lld [LLD][ELF] Optimize linker script filename glob pattern matching NFC 2020-09-16 10:26:11 +01:00
lib [CMake] Make `intrinsics_gen` dependency unconditional. 2020-07-17 16:43:17 -07:00
test Revert "[DebugInfo] Remove dots from getFilenameByIndex return value" 2020-09-15 10:06:47 -07:00
tools/lld [LLD] Allow configuring default ld.lld backend 2020-09-15 08:50:02 +03:00
unittests Use INTERFACE_COMPILE_OPTIONS to disable -Wsuggest-override for any target that links to gtest 2020-07-27 08:37:01 -07:00
utils Python 2/3 compatibility 2019-03-20 07:42:13 +00:00
wasm [lld][WebAssembly] Fix --export-all when __stack_pointer is present 2020-09-15 06:17:01 -07:00
.clang-format
.clang-tidy [lld] Add .clang-tidy to customize readability-identifier-naming.{Member,Parameter,Variable}Case => camelBack 2020-03-09 08:26:41 -07:00
.gitignore
CMakeLists.txt [LLD] Allow configuring default ld.lld backend 2020-09-15 08:50:02 +03:00
CODE_OWNERS.TXT Add code owners of new MachO port 2020-09-02 19:32:12 -07:00
LICENSE.TXT
README.md

README.md

LLVM Linker (lld)

This directory and its subdirectories contain source code for the LLVM Linker, a modular cross platform linker which is built as part of the LLVM compiler infrastructure project.

lld is open source software. You may freely distribute it under the terms of the license agreement found in LICENSE.txt.

Benchmarking

In order to make sure various developers can evaluate patches over the same tests, we create a collection of self contained programs.

It is hosted at https://s3-us-west-2.amazonaws.com/linker-tests/lld-speed-test.tar.xz

The current sha256 is 10eec685463d5a8bbf08d77f4ca96282161d396c65bd97dc99dbde644a31610f.