Replace autotools with CMake + fbcode_builder by mszabo-wikia · Pull Request #449 · facebook/mcrouter

mszabo-wikia · 2024-07-29T02:27:16Z

Part of the difficulty in building mcrouter as a third party stems from the fact that it uses an autotools-based build system. While other Meta OSS projects have adopted fbcode_builder to make it easier to build a project with all required dependencies, this tool was primarily written with CMake in mind and unfortunately wouldn't work with mcrouter's build system without making mcrouter-specific accommodations (e.g. explicitly passing in the Thrift compiler path and so on).

So, introduce a CMake-based build system for mcrouter and wire it up with fbcode_builder. This also allows for the tests (which had been nonfunctional in the autotools build for years) to be run in OSS CI via CMake/CTest, after some fixes for the GH Actions environment and disabling Meta-specific functionality in an OSS context. There are no changes to non-test/build files apart from the elimination of the generated config.h.

Use globbing extensively for generating source file lists in CMake files. While this may be a controversial approach, I think in this specific case the benefits outweigh the drawbacks, since this project doesn't use CMake internally so globbing can reduce the amount of times the OSS build needs to be fixed after the fact because a new source file wasn't added to it.

To assist reviewing, I've attempted to break this change into reasonable commits. The very first commit simply adds a vendored copy of fbcode_builder from a recent Folly checkout, hence the large diff size. I've not yet removed autotools paraphernalia to reduce the amount of changes in this PR—that can be done as a followup.

mszabo-wikia · 2024-07-29T02:28:32Z

Please let me know if you find this approach feasible—I'm not a CMake expert.

~~For actually applying these changes tofbcode_builder, I assume some internal work will need to be done on the Meta side.~~ (edit: I've submitted an appropriate Folly PR to do this)

mszabo-wikia · 2024-07-29T02:30:18Z

 namespace py3 hellogoodbye.thrift

-service HelloGoodbye extends fb303.FacebookService {
+service HelloGoodbye {


Ugly, but installing fb303 via fbcode_builder still doesn't help the Thrift compiler find fb303 IDLs. Since this is a test/example service, perhaps this is okay.

mszabo-wikia · 2024-07-29T02:32:57Z

  } else if (req.key_ref()->fullKey() == "shutdown") {
    shutdownLock_.post();
+    // TODO
+    std::this_thread::sleep_for(std::chrono::milliseconds(100));


I've observed a race condition in several tests in AsyncMcClientTestSync, e.g. qosClass, where the test would hang on shutdown without this, with the test thread waiting on the ->shutdown call, the server thread waiting on ->join and event loop threads still selecting, so I added this as a workaround since I wasn't able to find the exact cause of the race.

Some things I've tried to attempt to resolve this:

reordering the shutdownLock_ post,

introducing another synchronization barrier between the call to shutdown and join on the mock server main thread,

changing the worker loop to use loopOnce over loop and check isShutdown on each loop iteration, like some of the other mock servers do.

mszabo-wikia · 2024-07-29T02:35:33Z

                try:
                    res = self.thrift_client.mcVersion()
-                    if res == Result.OK:
+                    if res == carbon.carbon_result.thrift_types.Result.OK:


While this could be generated from the Carbon IDLs, createThriftTestClient isn't implemented in the OSS version of mcrouter_config.py, so it seems better to "hide" the Meta-specific bits instead.

https://github.com/facebook/mcrouter currently uses a legacy autotools-based build system, which forces third parties to rely on a collection of scripts hosted in the repository to build it with all required dependencies. This is brittle and has lead to many issue reports with build issues. In facebook/mcrouter#449, I've prepared a working CMake-based build system for mcrouter that could replace the legacy autotools setup. This patch adds the necessary manifests for mcrouter and its ragel dependency so that fbcode_builder itself will be setup for the repo without the PR having to do it.

mszabo-wikia · 2024-08-01T10:46:29Z

+include_directories(.)
+include_directories(${CMAKE_CURRENT_BINARY_DIR})


Not super sure about this, but this seems like the best way to support the current #include style.

Summary: X-link: https://github.com/facebookincubator/zstrong/pull/944 https://github.com/facebook/mcrouter currently uses a legacy autotools-based build system, which forces third parties to rely on a collection of scripts hosted in the repository to build it with all required dependencies. This is brittle and has lead to many issue reports about build problems. In facebook/mcrouter#449, I've prepared a working CMake-based build system for mcrouter that could replace the legacy autotools setup. This patch adds the necessary manifests for mcrouter and its ragel dependency so that fbcode_builder itself will be setup for the repo without having to do it in the PR. X-link: facebook/folly#2268 Reviewed By: yfeldblum Differential Revision: D60537337 Pulled By: Orvid fbshipit-source-id: ed73693d4af93acc3b8e996a7c61d0090075949f

Summary: X-link: https://github.com/facebookincubator/zstrong/pull/944 https://github.com/facebook/mcrouter currently uses a legacy autotools-based build system, which forces third parties to rely on a collection of scripts hosted in the repository to build it with all required dependencies. This is brittle and has lead to many issue reports about build problems. In facebook/mcrouter#449, I've prepared a working CMake-based build system for mcrouter that could replace the legacy autotools setup. This patch adds the necessary manifests for mcrouter and its ragel dependency so that fbcode_builder itself will be setup for the repo without having to do it in the PR. Pull Request resolved: #2268 Reviewed By: yfeldblum Differential Revision: D60537337 Pulled By: Orvid fbshipit-source-id: ed73693d4af93acc3b8e996a7c61d0090075949f

Summary: X-link: https://github.com/facebookincubator/zstrong/pull/944 https://github.com/facebook/mcrouter currently uses a legacy autotools-based build system, which forces third parties to rely on a collection of scripts hosted in the repository to build it with all required dependencies. This is brittle and has lead to many issue reports about build problems. In facebook/mcrouter#449, I've prepared a working CMake-based build system for mcrouter that could replace the legacy autotools setup. This patch adds the necessary manifests for mcrouter and its ragel dependency so that fbcode_builder itself will be setup for the repo without having to do it in the PR. X-link: facebook/folly#2268 Reviewed By: yfeldblum Differential Revision: D60537337 Pulled By: Orvid fbshipit-source-id: ed73693d4af93acc3b8e996a7c61d0090075949f

As observed in facebook#449, the OSS build currently produces various compiler warnings, mostly from OSS-specific stubs. Fix the following warnings: * Fix -Wunused-parameter in stub functions by commenting out the relevant parameters. * Fix -Wunused-local-typedef by removing unused typedefs. * Fix -Wreturn-local-addr in SRHost by returning a reference to a member variable instead. * Fix -Wredundant-move by removing a redundant std::move() call when returning a function parameter.

After 6c2142a, standalone mcrouter now deadlocks if router the configuration was incorrect. Spotted on facebook#449, where `test_unknown_named_handles` started failing due to the mcrouter process being tested never existing. GDB [indicates](https://gist.github.com/mszabo-wikia/47916c5655deffdb95332e972a52caf8) a deadlock between three threads: ``` (gdb) info threads Id Target Id Frame * 1 Thread 0x7f7b4cce1e00 (LWP 211878) "mcrouter" syscall () at ../sysdeps/unix/sysv/linux/x86_64/syscall.S:38 2 Thread 0x7f7b43fff6c0 (LWP 211882) "mcr-cpuaux-0" syscall () at ../sysdeps/unix/sysv/linux/x86_64/syscall.S:38 3 Thread 0x7f7b49e0a6c0 (LWP 211879) "IOThreadPool0" syscall () at ../sysdeps/unix/sysv/linux/x86_64/syscall.S:38 ``` Thread 1, the main thread, has triggered exit() and is waiting on the auxiliary thread pool to be destroyed. Thread 2, an auxiliary thread pool thread, is in the process of destroying the CarbonRouterInstance due to 6c2142a and is blocked on destroying the virtual EVBs by child proxies. These however are ultimately sourced from the IO thread pool which is also used by AsyncMcServer. Thread 3, an IO thread pool thread, is blocked by AsyncMcServer which is waiting to be started by later initialization code that never runs due to the config error, preventing the IO thread pool itself from being destroyed. Fix it by initializing the AsyncMcServer only after the router has been initialized.

mszabo-wikia · 2026-02-28T15:44:01Z

Closing since this is now in the works on main. Thanks!

facebook-github-bot added the CLA Signed label Jul 29, 2024

mszabo-wikia commented Jul 29, 2024

View reviewed changes

Comment thread mcrouter/tools/mcpiper/test/CMakeLists.txt Outdated

mszabo-wikia force-pushed the introduce-cmake branch 4 times, most recently from 90964da to 92cb3bd Compare July 31, 2024 14:13

mszabo-wikia mentioned this pull request Jul 31, 2024

Add fbcode_builder manifests for mcrouter and ragel facebook/folly#2268

Closed

mszabo-wikia force-pushed the introduce-cmake branch from 92cb3bd to 4d2a569 Compare July 31, 2024 15:56

mszabo-wikia commented Aug 1, 2024

View reviewed changes

mszabo-wikia mentioned this pull request Aug 4, 2024

Failed to build on Ubuntu 24.04 #447

Closed

mszabo-wikia force-pushed the introduce-cmake branch from 1eab3f0 to 04963d0 Compare August 11, 2024 08:27

mszabo-wikia mentioned this pull request Aug 13, 2024

MCRouter installation on UBUNTU-22 using source code. #452

Open

mszabo-wikia force-pushed the introduce-cmake branch 2 times, most recently from aa59940 to 74f2de6 Compare August 20, 2024 11:53

mszabo-wikia force-pushed the introduce-cmake branch from 99f1145 to f8b5bec Compare December 10, 2024 14:22

mszabo-wikia force-pushed the introduce-cmake branch from f8b5bec to 9bb6fa2 Compare December 11, 2024 11:15

mszabo-wikia mentioned this pull request Dec 11, 2024

Fix autotools build #457

Closed

mszabo-wikia and others added 23 commits February 14, 2026 02:55

Bootstrap fbcode_builder

db09bf2

Add CMake build system

c0bdffe

Add GitHub Action generated by getdeps.py

0266ec1

Hack: Eliminate fb303 dependency from example service

cf9379f

Skip CompressionCodecManagerTest when compression is disabled

699e8e8

Skip ServiceRouter tests when SR is not linked

a72bef0

Update test certificates to work with newer OpenSSL

e7247c6

Run Python integration tests as well

300e37a

Fix tests

7baa82a

Use folly::Init for mock servers to avoid glog warnings

f86a8d9

Set timeout for flaky tests in lib/network

72dd0b0

Add basic CPack packaging

364aae7

Update the README

14aa148

Fix refill lease-get test for OSS

f3e63c7

Lower timeout for integration tests

11b8249

Fix OSS compiler warnings

aa8015c

Fix flaky CarbonRouterClient.basicUsageSameThreadClient test

0e064a9

Exclude configerator-related test code in OSS build

9494df8

Update tests after miss-on-get removal

6b5307d

Don't use libfast-float-dev on bookworm

98759de

Rework library linking

3b6e06f

Fix FileDataProvider for newer Boost

446d5c1

Use deprecated_cpp_methods=none for mcrouter thrift codegen

fb0ded6

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Replace autotools with CMake + fbcode_builder#449

Replace autotools with CMake + fbcode_builder#449
mszabo-wikia wants to merge 23 commits intofacebook:mainfrom
mszabo-wikia:introduce-cmake

mszabo-wikia commented Jul 29, 2024 •

edited

Loading

Uh oh!

mszabo-wikia commented Jul 29, 2024 •

edited

Loading

Uh oh!

mszabo-wikia Jul 29, 2024

Uh oh!

mszabo-wikia Jul 29, 2024

Uh oh!

mszabo-wikia Aug 29, 2024

Uh oh!

mszabo-wikia Jul 29, 2024

Uh oh!

Uh oh!

mszabo-wikia Aug 1, 2024

Uh oh!

mszabo-wikia commented Feb 28, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

		include_directories(.)
		include_directories(${CMAKE_CURRENT_BINARY_DIR})

Conversation

mszabo-wikia commented Jul 29, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

mszabo-wikia commented Jul 29, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

mszabo-wikia Jul 29, 2024

Choose a reason for hiding this comment

Uh oh!

mszabo-wikia Jul 29, 2024

Choose a reason for hiding this comment

Uh oh!

mszabo-wikia Aug 29, 2024

Choose a reason for hiding this comment

Uh oh!

mszabo-wikia Jul 29, 2024

Choose a reason for hiding this comment

Uh oh!

Uh oh!

mszabo-wikia Aug 1, 2024

Choose a reason for hiding this comment

Uh oh!

mszabo-wikia commented Feb 28, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

mszabo-wikia commented Jul 29, 2024 •

edited

Loading

mszabo-wikia commented Jul 29, 2024 •

edited

Loading