blob: 1928097292a238a81269a01c8e6bd16c96c61b9b [file] [log] [blame] [view]
Abseil Teamcf942a52022-05-25 19:16:56 -07001# GoogleTest FAQ
Google Code Exporter642acbd2015-07-28 11:15:35 -04002
Gennadiy Civil5d3a2cd2019-01-03 17:18:03 -05003## Why should test suite names and test names not contain underscore?
Google Code Exporter642acbd2015-07-28 11:15:35 -04004
Abseil Teamd9c309f2021-02-18 19:18:34 -05005{: .callout .note}
Abseil Teamcf942a52022-05-25 19:16:56 -07006Note: GoogleTest reserves underscore (`_`) for special purpose keywords, such as
Abseil Team1fb1bb22020-09-29 21:52:15 -04007[the `DISABLED_` prefix](advanced.md#temporarily-disabling-tests), in addition
8to the following rationale.
9
Gennadiy Civil54379262018-07-17 17:47:25 -040010Underscore (`_`) is special, as C++ reserves the following to be used by the
11compiler and the standard library:
Google Code Exporter642acbd2015-07-28 11:15:35 -040012
Gennadiy Civil54379262018-07-17 17:47:25 -0400131. any identifier that starts with an `_` followed by an upper-case letter, and
Krystian Kuzniarekd384b882019-07-26 14:46:27 +0200142. any identifier that contains two consecutive underscores (i.e. `__`)
Gennadiy Civil54379262018-07-17 17:47:25 -040015 *anywhere* in its name.
Google Code Exporter642acbd2015-07-28 11:15:35 -040016
Gennadiy Civil54379262018-07-17 17:47:25 -040017User code is *prohibited* from using such identifiers.
Google Code Exporter642acbd2015-07-28 11:15:35 -040018
19Now let's look at what this means for `TEST` and `TEST_F`.
20
Gennadiy Civil5d3a2cd2019-01-03 17:18:03 -050021Currently `TEST(TestSuiteName, TestName)` generates a class named
22`TestSuiteName_TestName_Test`. What happens if `TestSuiteName` or `TestName`
Google Code Exporter642acbd2015-07-28 11:15:35 -040023contains `_`?
24
Gennadiy Civil5d3a2cd2019-01-03 17:18:03 -0500251. If `TestSuiteName` starts with an `_` followed by an upper-case letter (say,
Gennadiy Civil54379262018-07-17 17:47:25 -040026 `_Foo`), we end up with `_Foo_TestName_Test`, which is reserved and thus
27 invalid.
Krystian Kuzniarekd384b882019-07-26 14:46:27 +0200282. If `TestSuiteName` ends with an `_` (say, `Foo_`), we get
Gennadiy Civil54379262018-07-17 17:47:25 -040029 `Foo__TestName_Test`, which is invalid.
Krystian Kuzniarekd384b882019-07-26 14:46:27 +0200303. If `TestName` starts with an `_` (say, `_Bar`), we get
Gennadiy Civil5d3a2cd2019-01-03 17:18:03 -050031 `TestSuiteName__Bar_Test`, which is invalid.
Krystian Kuzniarekd384b882019-07-26 14:46:27 +0200324. If `TestName` ends with an `_` (say, `Bar_`), we get
Gennadiy Civil5d3a2cd2019-01-03 17:18:03 -050033 `TestSuiteName_Bar__Test`, which is invalid.
Google Code Exporter642acbd2015-07-28 11:15:35 -040034
Gennadiy Civil834dff32019-06-24 11:16:58 -040035So clearly `TestSuiteName` and `TestName` cannot start or end with `_`
36(Actually, `TestSuiteName` can start with `_` -- as long as the `_` isn't
37followed by an upper-case letter. But that's getting complicated. So for
38simplicity we just say that it cannot start with `_`.).
Google Code Exporter642acbd2015-07-28 11:15:35 -040039
Gennadiy Civil834dff32019-06-24 11:16:58 -040040It may seem fine for `TestSuiteName` and `TestName` to contain `_` in the
41middle. However, consider this:
Gennadiy Civil54379262018-07-17 17:47:25 -040042
Gennadiy Civil3847aec2018-06-13 14:29:26 -040043```c++
Google Code Exporter642acbd2015-07-28 11:15:35 -040044TEST(Time, Flies_Like_An_Arrow) { ... }
45TEST(Time_Flies, Like_An_Arrow) { ... }
46```
47
48Now, the two `TEST`s will both generate the same class
Gennadiy Civil54379262018-07-17 17:47:25 -040049(`Time_Flies_Like_An_Arrow_Test`). That's not good.
Google Code Exporter642acbd2015-07-28 11:15:35 -040050
Gennadiy Civil5d3a2cd2019-01-03 17:18:03 -050051So for simplicity, we just ask the users to avoid `_` in `TestSuiteName` and
Gennadiy Civil54379262018-07-17 17:47:25 -040052`TestName`. The rule is more constraining than necessary, but it's simple and
Abseil Teamcf942a52022-05-25 19:16:56 -070053easy to remember. It also gives GoogleTest some wiggle room in case its
Gennadiy Civil54379262018-07-17 17:47:25 -040054implementation needs to change in the future.
Google Code Exporter642acbd2015-07-28 11:15:35 -040055
Gennadiy Civil54379262018-07-17 17:47:25 -040056If you violate the rule, there may not be immediate consequences, but your test
57may (just may) break with a new compiler (or a new version of the compiler you
Abseil Teamcf942a52022-05-25 19:16:56 -070058are using) or with a new version of GoogleTest. Therefore it's best to follow
Gennadiy Civil54379262018-07-17 17:47:25 -040059the rule.
Google Code Exporter642acbd2015-07-28 11:15:35 -040060
Abseil Teamcf942a52022-05-25 19:16:56 -070061## Why does GoogleTest support `EXPECT_EQ(NULL, ptr)` and `ASSERT_EQ(NULL, ptr)` but not `EXPECT_NE(NULL, ptr)` and `ASSERT_NE(NULL, ptr)`?
Google Code Exporter642acbd2015-07-28 11:15:35 -040062
Abseil Team45957452021-03-23 13:08:11 -070063First of all, you can use `nullptr` with each of these macros, e.g.
64`EXPECT_EQ(ptr, nullptr)`, `EXPECT_NE(ptr, nullptr)`, `ASSERT_EQ(ptr, nullptr)`,
65`ASSERT_NE(ptr, nullptr)`. This is the preferred syntax in the style guide
66because `nullptr` does not have the type problems that `NULL` does.
Google Code Exporter642acbd2015-07-28 11:15:35 -040067
Gennadiy Civil54379262018-07-17 17:47:25 -040068Due to some peculiarity of C++, it requires some non-trivial template meta
69programming tricks to support using `NULL` as an argument of the `EXPECT_XX()`
70and `ASSERT_XX()` macros. Therefore we only do it where it's most needed
Abseil Teamcf942a52022-05-25 19:16:56 -070071(otherwise we make the implementation of GoogleTest harder to maintain and more
Gennadiy Civil54379262018-07-17 17:47:25 -040072error-prone than necessary).
Google Code Exporter642acbd2015-07-28 11:15:35 -040073
Abseil Team45957452021-03-23 13:08:11 -070074Historically, the `EXPECT_EQ()` macro took the *expected* value as its first
75argument and the *actual* value as the second, though this argument order is now
76discouraged. It was reasonable that someone wanted
77to write `EXPECT_EQ(NULL, some_expression)`, and this indeed was requested
78several times. Therefore we implemented it.
Google Code Exporter642acbd2015-07-28 11:15:35 -040079
Abseil Team45957452021-03-23 13:08:11 -070080The need for `EXPECT_NE(NULL, ptr)` wasn't nearly as strong. When the assertion
Gennadiy Civil54379262018-07-17 17:47:25 -040081fails, you already know that `ptr` must be `NULL`, so it doesn't add any
82information to print `ptr` in this case. That means `EXPECT_TRUE(ptr != NULL)`
83works just as well.
Google Code Exporter642acbd2015-07-28 11:15:35 -040084
Abseil Team45957452021-03-23 13:08:11 -070085If we were to support `EXPECT_NE(NULL, ptr)`, for consistency we'd have to
86support `EXPECT_NE(ptr, NULL)` as well. This means using the template meta
87programming tricks twice in the implementation, making it even harder to
88understand and maintain. We believe the benefit doesn't justify the cost.
Google Code Exporter642acbd2015-07-28 11:15:35 -040089
Gennadiy Civil54379262018-07-17 17:47:25 -040090Finally, with the growth of the gMock matcher library, we are encouraging people
91to use the unified `EXPECT_THAT(value, matcher)` syntax more often in tests. One
92significant advantage of the matcher approach is that matchers can be easily
93combined to form new matchers, while the `EXPECT_NE`, etc, macros cannot be
94easily combined. Therefore we want to invest more in the matchers than in the
Google Code Exporter642acbd2015-07-28 11:15:35 -040095`EXPECT_XX()` macros.
96
Gennadiy Civil54379262018-07-17 17:47:25 -040097## I need to test that different implementations of an interface satisfy some common requirements. Should I use typed tests or value-parameterized tests?
Google Code Exporter642acbd2015-07-28 11:15:35 -040098
Gennadiy Civil54379262018-07-17 17:47:25 -040099For testing various implementations of the same interface, either typed tests or
100value-parameterized tests can get it done. It's really up to you the user to
101decide which is more convenient for you, depending on your particular case. Some
102rough guidelines:
Google Code Exporter642acbd2015-07-28 11:15:35 -0400103
Gennadiy Civil54379262018-07-17 17:47:25 -0400104* Typed tests can be easier to write if instances of the different
105 implementations can be created the same way, modulo the type. For example,
106 if all these implementations have a public default constructor (such that
107 you can write `new TypeParam`), or if their factory functions have the same
108 form (e.g. `CreateInstance<TypeParam>()`).
109* Value-parameterized tests can be easier to write if you need different code
110 patterns to create different implementations' instances, e.g. `new Foo` vs
111 `new Bar(5)`. To accommodate for the differences, you can write factory
112 function wrappers and pass these function pointers to the tests as their
113 parameters.
Gennadiy Civil834dff32019-06-24 11:16:58 -0400114* When a typed test fails, the default output includes the name of the type,
115 which can help you quickly identify which implementation is wrong.
116 Value-parameterized tests only show the number of the failed iteration by
117 default. You will need to define a function that returns the iteration name
118 and pass it as the third parameter to INSTANTIATE_TEST_SUITE_P to have more
119 useful output.
Gennadiy Civil54379262018-07-17 17:47:25 -0400120* When using typed tests, you need to make sure you are testing against the
121 interface type, not the concrete types (in other words, you want to make
122 sure `implicit_cast<MyInterface*>(my_concrete_impl)` works, not just that
123 `my_concrete_impl` works). It's less likely to make mistakes in this area
124 when using value-parameterized tests.
Google Code Exporter642acbd2015-07-28 11:15:35 -0400125
Gennadiy Civil54379262018-07-17 17:47:25 -0400126I hope I didn't confuse you more. :-) If you don't mind, I'd suggest you to give
127both approaches a try. Practice is a much better way to grasp the subtle
128differences between the two tools. Once you have some concrete experience, you
129can much more easily decide which one to use the next time.
Google Code Exporter642acbd2015-07-28 11:15:35 -0400130
Gennadiy Civil54379262018-07-17 17:47:25 -0400131## I got some run-time errors about invalid proto descriptors when using `ProtocolMessageEquals`. Help!
132
Abseil Teamd9c309f2021-02-18 19:18:34 -0500133{: .callout .note}
Gennadiy Civil54379262018-07-17 17:47:25 -0400134**Note:** `ProtocolMessageEquals` and `ProtocolMessageEquiv` are *deprecated*
135now. Please use `EqualsProto`, etc instead.
136
137`ProtocolMessageEquals` and `ProtocolMessageEquiv` were redefined recently and
Gennadiy Civil834dff32019-06-24 11:16:58 -0400138are now less tolerant of invalid protocol buffer definitions. In particular, if
Gennadiy Civil54379262018-07-17 17:47:25 -0400139you have a `foo.proto` that doesn't fully qualify the type of a protocol message
140it references (e.g. `message<Bar>` where it should be `message<blah.Bar>`), you
141will now get run-time errors like:
142
Google Code Exporter642acbd2015-07-28 11:15:35 -0400143```
Gennadiy Civil54379262018-07-17 17:47:25 -0400144... descriptor.cc:...] Invalid proto descriptor for file "path/to/foo.proto":
145... descriptor.cc:...] blah.MyMessage.my_field: ".Bar" is not defined.
Google Code Exporter642acbd2015-07-28 11:15:35 -0400146```
147
Gennadiy Civil54379262018-07-17 17:47:25 -0400148If you see this, your `.proto` file is broken and needs to be fixed by making
149the types fully qualified. The new definition of `ProtocolMessageEquals` and
150`ProtocolMessageEquiv` just happen to reveal your bug.
Google Code Exporter642acbd2015-07-28 11:15:35 -0400151
Gennadiy Civil54379262018-07-17 17:47:25 -0400152## My death test modifies some state, but the change seems lost after the death test finishes. Why?
Google Code Exporter642acbd2015-07-28 11:15:35 -0400153
154Death tests (`EXPECT_DEATH`, etc) are executed in a sub-process s.t. the
155expected crash won't kill the test program (i.e. the parent process). As a
Gennadiy Civil54379262018-07-17 17:47:25 -0400156result, any in-memory side effects they incur are observable in their respective
157sub-processes, but not in the parent process. You can think of them as running
158in a parallel universe, more or less.
Google Code Exporter642acbd2015-07-28 11:15:35 -0400159
Gennadiy Civil834dff32019-06-24 11:16:58 -0400160In particular, if you use mocking and the death test statement invokes some mock
161methods, the parent process will think the calls have never occurred. Therefore,
162you may want to move your `EXPECT_CALL` statements inside the `EXPECT_DEATH`
163macro.
Gennadiy Civil54379262018-07-17 17:47:25 -0400164
Abseil Teamcf942a52022-05-25 19:16:56 -0700165## EXPECT_EQ(htonl(blah), blah_blah) generates weird compiler errors in opt mode. Is this a GoogleTest bug?
Gennadiy Civil54379262018-07-17 17:47:25 -0400166
167Actually, the bug is in `htonl()`.
168
169According to `'man htonl'`, `htonl()` is a *function*, which means it's valid to
170use `htonl` as a function pointer. However, in opt mode `htonl()` is defined as
171a *macro*, which breaks this usage.
172
173Worse, the macro definition of `htonl()` uses a `gcc` extension and is *not*
174standard C++. That hacky implementation has some ad hoc limitations. In
175particular, it prevents you from writing `Foo<sizeof(htonl(x))>()`, where `Foo`
176is a template that has an integral argument.
177
178The implementation of `EXPECT_EQ(a, b)` uses `sizeof(... a ...)` inside a
179template argument, and thus doesn't compile in opt mode when `a` contains a call
180to `htonl()`. It is difficult to make `EXPECT_EQ` bypass the `htonl()` bug, as
181the solution must work with different compilers on various platforms.
182
Gennadiy Civil54379262018-07-17 17:47:25 -0400183## The compiler complains about "undefined references" to some static const member variables, but I did define them in the class body. What's wrong?
Google Code Exporter642acbd2015-07-28 11:15:35 -0400184
185If your class has a static data member:
186
Gennadiy Civil3847aec2018-06-13 14:29:26 -0400187```c++
Google Code Exporter642acbd2015-07-28 11:15:35 -0400188// foo.h
189class Foo {
190 ...
191 static const int kBar = 100;
192};
193```
194
Gennadiy Civil54379262018-07-17 17:47:25 -0400195You also need to define it *outside* of the class body in `foo.cc`:
Google Code Exporter642acbd2015-07-28 11:15:35 -0400196
Gennadiy Civil3847aec2018-06-13 14:29:26 -0400197```c++
Google Code Exporter642acbd2015-07-28 11:15:35 -0400198const int Foo::kBar; // No initializer here.
199```
200
201Otherwise your code is **invalid C++**, and may break in unexpected ways. In
Abseil Teamcf942a52022-05-25 19:16:56 -0700202particular, using it in GoogleTest comparison assertions (`EXPECT_EQ`, etc) will
Gennadiy Civil54379262018-07-17 17:47:25 -0400203generate an "undefined reference" linker error. The fact that "it used to work"
204doesn't mean it's valid. It just means that you were lucky. :-)
Google Code Exporter642acbd2015-07-28 11:15:35 -0400205
Abseil Teamefe70362020-11-19 09:13:24 -0500206If the declaration of the static data member is `constexpr` then it is
207implicitly an `inline` definition, and a separate definition in `foo.cc` is not
208needed:
209
210```c++
211// foo.h
212class Foo {
213 ...
214 static constexpr int kBar = 100; // Defines kBar, no need to do it in foo.cc.
215};
216```
217
Gennadiy Civil54379262018-07-17 17:47:25 -0400218## Can I derive a test fixture from another?
Google Code Exporter642acbd2015-07-28 11:15:35 -0400219
220Yes.
221
Gennadiy Civil834dff32019-06-24 11:16:58 -0400222Each test fixture has a corresponding and same named test suite. This means only
223one test suite can use a particular fixture. Sometimes, however, multiple test
Google Code Exporter642acbd2015-07-28 11:15:35 -0400224cases may want to use the same or slightly different fixtures. For example, you
Gennadiy Civil834dff32019-06-24 11:16:58 -0400225may want to make sure that all of a GUI library's test suites don't leak
Google Code Exporter642acbd2015-07-28 11:15:35 -0400226important system resources like fonts and brushes.
227
Abseil Teamcf942a52022-05-25 19:16:56 -0700228In GoogleTest, you share a fixture among test suites by putting the shared logic
Gennadiy Civil54379262018-07-17 17:47:25 -0400229in a base test fixture, then deriving from that base a separate fixture for each
Gennadiy Civil834dff32019-06-24 11:16:58 -0400230test suite that wants to use this common logic. You then use `TEST_F()` to write
Gennadiy Civil54379262018-07-17 17:47:25 -0400231tests using each derived fixture.
Google Code Exporter642acbd2015-07-28 11:15:35 -0400232
233Typically, your code looks like this:
234
Gennadiy Civil3847aec2018-06-13 14:29:26 -0400235```c++
Google Code Exporter642acbd2015-07-28 11:15:35 -0400236// Defines a base test fixture.
237class BaseTest : public ::testing::Test {
Gennadiy Civil54379262018-07-17 17:47:25 -0400238 protected:
239 ...
Google Code Exporter642acbd2015-07-28 11:15:35 -0400240};
241
242// Derives a fixture FooTest from BaseTest.
243class FooTest : public BaseTest {
Gennadiy Civil54379262018-07-17 17:47:25 -0400244 protected:
245 void SetUp() override {
246 BaseTest::SetUp(); // Sets up the base fixture first.
247 ... additional set-up work ...
248 }
249
250 void TearDown() override {
251 ... clean-up work for FooTest ...
252 BaseTest::TearDown(); // Remember to tear down the base fixture
253 // after cleaning up FooTest!
254 }
255
256 ... functions and variables for FooTest ...
Google Code Exporter642acbd2015-07-28 11:15:35 -0400257};
258
259// Tests that use the fixture FooTest.
260TEST_F(FooTest, Bar) { ... }
261TEST_F(FooTest, Baz) { ... }
262
263... additional fixtures derived from BaseTest ...
264```
265
266If necessary, you can continue to derive test fixtures from a derived fixture.
Abseil Teamcf942a52022-05-25 19:16:56 -0700267GoogleTest has no limit on how deep the hierarchy can be.
Google Code Exporter642acbd2015-07-28 11:15:35 -0400268
Gennadiy Civil834dff32019-06-24 11:16:58 -0400269For a complete example using derived test fixtures, see
assafprb59ae842022-06-22 16:12:54 +0300270[sample5_unittest.cc](https://github.com/google/googletest/blob/main/googletest/samples/sample5_unittest.cc).
Google Code Exporter642acbd2015-07-28 11:15:35 -0400271
Gennadiy Civil54379262018-07-17 17:47:25 -0400272## My compiler complains "void value not ignored as it ought to be." What does this mean?
Google Code Exporter642acbd2015-07-28 11:15:35 -0400273
274You're probably using an `ASSERT_*()` in a function that doesn't return `void`.
Gennadiy Civil54379262018-07-17 17:47:25 -0400275`ASSERT_*()` can only be used in `void` functions, due to exceptions being
276disabled by our build system. Please see more details
277[here](advanced.md#assertion-placement).
Google Code Exporter642acbd2015-07-28 11:15:35 -0400278
Gennadiy Civil54379262018-07-17 17:47:25 -0400279## My death test hangs (or seg-faults). How do I fix it?
Google Code Exporter642acbd2015-07-28 11:15:35 -0400280
Abseil Teamcf942a52022-05-25 19:16:56 -0700281In GoogleTest, death tests are run in a child process and the way they work is
Abseil Teamd5d6ff92021-05-25 19:49:11 -0400282delicate. To write death tests you really need to understand how they work—see
283the details at [Death Assertions](reference/assertions.md#death) in the
284Assertions Reference.
Google Code Exporter642acbd2015-07-28 11:15:35 -0400285
286In particular, death tests don't like having multiple threads in the parent
Gennadiy Civil54379262018-07-17 17:47:25 -0400287process. So the first thing you can try is to eliminate creating threads outside
Gennadiy Civil834dff32019-06-24 11:16:58 -0400288of `EXPECT_DEATH()`. For example, you may want to use mocks or fake objects
289instead of real ones in your tests.
Google Code Exporter642acbd2015-07-28 11:15:35 -0400290
291Sometimes this is impossible as some library you must use may be creating
292threads before `main()` is even reached. In this case, you can try to minimize
293the chance of conflicts by either moving as many activities as possible inside
294`EXPECT_DEATH()` (in the extreme case, you want to move everything inside), or
Gennadiy Civil54379262018-07-17 17:47:25 -0400295leaving as few things as possible in it. Also, you can try to set the death test
296style to `"threadsafe"`, which is safer but slower, and see if it helps.
Google Code Exporter642acbd2015-07-28 11:15:35 -0400297
298If you go with thread-safe death tests, remember that they rerun the test
299program from the beginning in the child process. Therefore make sure your
300program can run side-by-side with itself and is deterministic.
301
302In the end, this boils down to good concurrent programming. You have to make
Ashik Paulc4a5ee32020-07-11 12:13:05 +0530303sure that there are no race conditions or deadlocks in your program. No silver
Google Code Exporter642acbd2015-07-28 11:15:35 -0400304bullet - sorry!
305
Abseil Team6123df92019-09-05 17:40:42 -0400306## Should I use the constructor/destructor of the test fixture or SetUp()/TearDown()? {#CtorVsSetUp}
Google Code Exporter642acbd2015-07-28 11:15:35 -0400307
Abseil Teamcf942a52022-05-25 19:16:56 -0700308The first thing to remember is that GoogleTest does **not** reuse the same test
309fixture object across multiple tests. For each `TEST_F`, GoogleTest will create
Gennadiy Civil54379262018-07-17 17:47:25 -0400310a **fresh** test fixture object, immediately call `SetUp()`, run the test body,
311call `TearDown()`, and then delete the test fixture object.
Google Code Exporter642acbd2015-07-28 11:15:35 -0400312
Gennadiy Civil54379262018-07-17 17:47:25 -0400313When you need to write per-test set-up and tear-down logic, you have the choice
314between using the test fixture constructor/destructor or `SetUp()/TearDown()`.
315The former is usually preferred, as it has the following benefits:
Google Code Exporter642acbd2015-07-28 11:15:35 -0400316
Gennadiy Civil54379262018-07-17 17:47:25 -0400317* By initializing a member variable in the constructor, we have the option to
318 make it `const`, which helps prevent accidental changes to its value and
319 makes the tests more obviously correct.
320* In case we need to subclass the test fixture class, the subclass'
321 constructor is guaranteed to call the base class' constructor *first*, and
322 the subclass' destructor is guaranteed to call the base class' destructor
323 *afterward*. With `SetUp()/TearDown()`, a subclass may make the mistake of
324 forgetting to call the base class' `SetUp()/TearDown()` or call them at the
325 wrong time.
Google Code Exporter642acbd2015-07-28 11:15:35 -0400326
Gennadiy Civil834dff32019-06-24 11:16:58 -0400327You may still want to use `SetUp()/TearDown()` in the following cases:
Google Code Exporter642acbd2015-07-28 11:15:35 -0400328
Gennadiy Civil834dff32019-06-24 11:16:58 -0400329* C++ does not allow virtual function calls in constructors and destructors.
330 You can call a method declared as virtual, but it will not use dynamic
Abseil Team2d07f122022-01-12 07:19:16 -0800331 dispatch. It will use the definition from the class the constructor of which
Gennadiy Civil834dff32019-06-24 11:16:58 -0400332 is currently executing. This is because calling a virtual method before the
333 derived class constructor has a chance to run is very dangerous - the
334 virtual method might operate on uninitialized data. Therefore, if you need
335 to call a method that will be overridden in a derived class, you have to use
336 `SetUp()/TearDown()`.
Gennadiy Civil54379262018-07-17 17:47:25 -0400337* In the body of a constructor (or destructor), it's not possible to use the
338 `ASSERT_xx` macros. Therefore, if the set-up operation could cause a fatal
339 test failure that should prevent the test from running, it's necessary to
Abseil Team8a761862021-01-25 20:51:26 -0500340 use `abort` and abort the whole test
341 executable, or to use `SetUp()` instead of a constructor.
Gennadiy Civil54379262018-07-17 17:47:25 -0400342* If the tear-down operation could throw an exception, you must use
343 `TearDown()` as opposed to the destructor, as throwing in a destructor leads
344 to undefined behavior and usually will kill your program right away. Note
345 that many standard libraries (like STL) may throw when exceptions are
346 enabled in the compiler. Therefore you should prefer `TearDown()` if you
347 want to write portable tests that work with or without exceptions.
Abseil Teamcf942a52022-05-25 19:16:56 -0700348* The GoogleTest team is considering making the assertion macros throw on
Gennadiy Civil54379262018-07-17 17:47:25 -0400349 platforms where exceptions are enabled (e.g. Windows, Mac OS, and Linux
350 client-side), which will eliminate the need for the user to propagate
351 failures from a subroutine to its caller. Therefore, you shouldn't use
Abseil Teamcf942a52022-05-25 19:16:56 -0700352 GoogleTest assertions in a destructor if your code could run on such a
Gennadiy Civil54379262018-07-17 17:47:25 -0400353 platform.
Gennadiy Civil54379262018-07-17 17:47:25 -0400354
355## The compiler complains "no matching function to call" when I use ASSERT_PRED*. How do I fix it?
Google Code Exporter642acbd2015-07-28 11:15:35 -0400356
Abseil Teamd5d6ff92021-05-25 19:49:11 -0400357See details for [`EXPECT_PRED*`](reference/assertions.md#EXPECT_PRED) in the
358Assertions Reference.
Google Code Exporter642acbd2015-07-28 11:15:35 -0400359
Gennadiy Civil54379262018-07-17 17:47:25 -0400360## My compiler complains about "ignoring return value" when I call RUN_ALL_TESTS(). Why?
Google Code Exporter642acbd2015-07-28 11:15:35 -0400361
362Some people had been ignoring the return value of `RUN_ALL_TESTS()`. That is,
363instead of
364
Gennadiy Civil3847aec2018-06-13 14:29:26 -0400365```c++
Gennadiy Civil54379262018-07-17 17:47:25 -0400366 return RUN_ALL_TESTS();
Google Code Exporter642acbd2015-07-28 11:15:35 -0400367```
368
369they write
370
Gennadiy Civil3847aec2018-06-13 14:29:26 -0400371```c++
Gennadiy Civil54379262018-07-17 17:47:25 -0400372 RUN_ALL_TESTS();
Google Code Exporter642acbd2015-07-28 11:15:35 -0400373```
374
Gennadiy Civil54379262018-07-17 17:47:25 -0400375This is **wrong and dangerous**. The testing services needs to see the return
376value of `RUN_ALL_TESTS()` in order to determine if a test has passed. If your
377`main()` function ignores it, your test will be considered successful even if it
Abseil Teamcf942a52022-05-25 19:16:56 -0700378has a GoogleTest assertion failure. Very bad.
Google Code Exporter642acbd2015-07-28 11:15:35 -0400379
Gennadiy Civil54379262018-07-17 17:47:25 -0400380We have decided to fix this (thanks to Michael Chastain for the idea). Now, your
381code will no longer be able to ignore `RUN_ALL_TESTS()` when compiled with
382`gcc`. If you do so, you'll get a compiler error.
Google Code Exporter642acbd2015-07-28 11:15:35 -0400383
Gennadiy Civil54379262018-07-17 17:47:25 -0400384If you see the compiler complaining about you ignoring the return value of
385`RUN_ALL_TESTS()`, the fix is simple: just make sure its value is used as the
386return value of `main()`.
387
388But how could we introduce a change that breaks existing tests? Well, in this
389case, the code was already broken in the first place, so we didn't break it. :-)
390
391## My compiler complains that a constructor (or destructor) cannot return a value. What's going on?
Google Code Exporter642acbd2015-07-28 11:15:35 -0400392
393Due to a peculiarity of C++, in order to support the syntax for streaming
394messages to an `ASSERT_*`, e.g.
395
Gennadiy Civil3847aec2018-06-13 14:29:26 -0400396```c++
Gennadiy Civil54379262018-07-17 17:47:25 -0400397 ASSERT_EQ(1, Foo()) << "blah blah" << foo;
Google Code Exporter642acbd2015-07-28 11:15:35 -0400398```
399
400we had to give up using `ASSERT*` and `FAIL*` (but not `EXPECT*` and
401`ADD_FAILURE*`) in constructors and destructors. The workaround is to move the
402content of your constructor/destructor to a private void member function, or
Gennadiy Civil54379262018-07-17 17:47:25 -0400403switch to `EXPECT_*()` if that works. This
404[section](advanced.md#assertion-placement) in the user's guide explains it.
Google Code Exporter642acbd2015-07-28 11:15:35 -0400405
Gennadiy Civil54379262018-07-17 17:47:25 -0400406## My SetUp() function is not called. Why?
Google Code Exporter642acbd2015-07-28 11:15:35 -0400407
Gennadiy Civil54379262018-07-17 17:47:25 -0400408C++ is case-sensitive. Did you spell it as `Setup()`?
Google Code Exporter642acbd2015-07-28 11:15:35 -0400409
Gennadiy Civil5d3a2cd2019-01-03 17:18:03 -0500410Similarly, sometimes people spell `SetUpTestSuite()` as `SetupTestSuite()` and
Google Code Exporter642acbd2015-07-28 11:15:35 -0400411wonder why it's never called.
412
Gennadiy Civil834dff32019-06-24 11:16:58 -0400413## I have several test suites which share the same test fixture logic, do I have to define a new test fixture class for each of them? This seems pretty tedious.
Google Code Exporter642acbd2015-07-28 11:15:35 -0400414
415You don't have to. Instead of
416
Gennadiy Civil3847aec2018-06-13 14:29:26 -0400417```c++
Google Code Exporter642acbd2015-07-28 11:15:35 -0400418class FooTest : public BaseTest {};
419
420TEST_F(FooTest, Abc) { ... }
421TEST_F(FooTest, Def) { ... }
422
423class BarTest : public BaseTest {};
424
425TEST_F(BarTest, Abc) { ... }
426TEST_F(BarTest, Def) { ... }
427```
428
429you can simply `typedef` the test fixtures:
Gennadiy Civil54379262018-07-17 17:47:25 -0400430
Gennadiy Civil3847aec2018-06-13 14:29:26 -0400431```c++
Google Code Exporter642acbd2015-07-28 11:15:35 -0400432typedef BaseTest FooTest;
433
434TEST_F(FooTest, Abc) { ... }
435TEST_F(FooTest, Def) { ... }
436
437typedef BaseTest BarTest;
438
439TEST_F(BarTest, Abc) { ... }
440TEST_F(BarTest, Def) { ... }
441```
442
Abseil Teamcf942a52022-05-25 19:16:56 -0700443## GoogleTest output is buried in a whole bunch of LOG messages. What do I do?
Google Code Exporter642acbd2015-07-28 11:15:35 -0400444
Abseil Teamcf942a52022-05-25 19:16:56 -0700445The GoogleTest output is meant to be a concise and human-friendly report. If
446your test generates textual output itself, it will mix with the GoogleTest
Google Code Exporter642acbd2015-07-28 11:15:35 -0400447output, making it hard to read. However, there is an easy solution to this
448problem.
449
Abseil Teamcf942a52022-05-25 19:16:56 -0700450Since `LOG` messages go to stderr, we decided to let GoogleTest output go to
Gennadiy Civil54379262018-07-17 17:47:25 -0400451stdout. This way, you can easily separate the two using redirection. For
Google Code Exporter642acbd2015-07-28 11:15:35 -0400452example:
Gennadiy Civil54379262018-07-17 17:47:25 -0400453
454```shell
455$ ./my_test > gtest_output.txt
Google Code Exporter642acbd2015-07-28 11:15:35 -0400456```
457
Gennadiy Civil54379262018-07-17 17:47:25 -0400458## Why should I prefer test fixtures over global variables?
Google Code Exporter642acbd2015-07-28 11:15:35 -0400459
460There are several good reasons:
Google Code Exporter642acbd2015-07-28 11:15:35 -0400461
Gennadiy Civil54379262018-07-17 17:47:25 -04004621. It's likely your test needs to change the states of its global variables.
463 This makes it difficult to keep side effects from escaping one test and
464 contaminating others, making debugging difficult. By using fixtures, each
465 test has a fresh set of variables that's different (but with the same
466 names). Thus, tests are kept independent of each other.
Krystian Kuzniarekd384b882019-07-26 14:46:27 +02004672. Global variables pollute the global namespace.
4683. Test fixtures can be reused via subclassing, which cannot be done easily
Gennadiy Civil834dff32019-06-24 11:16:58 -0400469 with global variables. This is useful if many test suites have something in
Gennadiy Civil54379262018-07-17 17:47:25 -0400470 common.
Google Code Exporter642acbd2015-07-28 11:15:35 -0400471
Gennadiy Civil834dff32019-06-24 11:16:58 -0400472## What can the statement argument in ASSERT_DEATH() be?
Google Code Exporter642acbd2015-07-28 11:15:35 -0400473
hyuk.myeong51f73962019-10-01 14:24:55 +0900474`ASSERT_DEATH(statement, matcher)` (or any death assertion macro) can be used
475wherever *`statement`* is valid. So basically *`statement`* can be any C++
Google Code Exporter642acbd2015-07-28 11:15:35 -0400476statement that makes sense in the current context. In particular, it can
477reference global and/or local variables, and can be:
Gennadiy Civil54379262018-07-17 17:47:25 -0400478
479* a simple function call (often the case),
480* a complex expression, or
481* a compound statement.
Google Code Exporter642acbd2015-07-28 11:15:35 -0400482
Arkady Shapkin83b93ea2015-11-28 17:59:51 +0300483Some examples are shown here:
484
Gennadiy Civil3847aec2018-06-13 14:29:26 -0400485```c++
Google Code Exporter642acbd2015-07-28 11:15:35 -0400486// A death test can be a simple function call.
487TEST(MyDeathTest, FunctionCall) {
488 ASSERT_DEATH(Xyz(5), "Xyz failed");
489}
490
491// Or a complex expression that references variables and functions.
492TEST(MyDeathTest, ComplexExpression) {
493 const bool c = Condition();
494 ASSERT_DEATH((c ? Func1(0) : object2.Method("test")),
495 "(Func1|Method) failed");
496}
497
Ashik Paulc4a5ee32020-07-11 12:13:05 +0530498// Death assertions can be used anywhere in a function. In
Google Code Exporter642acbd2015-07-28 11:15:35 -0400499// particular, they can be inside a loop.
500TEST(MyDeathTest, InsideLoop) {
501 // Verifies that Foo(0), Foo(1), ..., and Foo(4) all die.
502 for (int i = 0; i < 5; i++) {
503 EXPECT_DEATH_M(Foo(i), "Foo has \\d+ errors",
504 ::testing::Message() << "where i is " << i);
505 }
506}
507
508// A death assertion can contain a compound statement.
509TEST(MyDeathTest, CompoundStatement) {
510 // Verifies that at lease one of Bar(0), Bar(1), ..., and
511 // Bar(4) dies.
512 ASSERT_DEATH({
513 for (int i = 0; i < 5; i++) {
514 Bar(i);
515 }
516 },
Gennadiy Civil54379262018-07-17 17:47:25 -0400517 "Bar has \\d+ errors");
518}
Google Code Exporter642acbd2015-07-28 11:15:35 -0400519```
520
Gennadiy Civil54379262018-07-17 17:47:25 -0400521## I have a fixture class `FooTest`, but `TEST_F(FooTest, Bar)` gives me error ``"no matching function for call to `FooTest::FooTest()'"``. Why?
Google Code Exporter642acbd2015-07-28 11:15:35 -0400522
Abseil Teamcf942a52022-05-25 19:16:56 -0700523GoogleTest needs to be able to create objects of your test fixture class, so it
Gennadiy Civil54379262018-07-17 17:47:25 -0400524must have a default constructor. Normally the compiler will define one for you.
525However, there are cases where you have to define your own:
Google Code Exporter642acbd2015-07-28 11:15:35 -0400526
Gennadiy Civil54379262018-07-17 17:47:25 -0400527* If you explicitly declare a non-default constructor for class `FooTest`
528 (`DISALLOW_EVIL_CONSTRUCTORS()` does this), then you need to define a
529 default constructor, even if it would be empty.
530* If `FooTest` has a const non-static data member, then you have to define the
531 default constructor *and* initialize the const member in the initializer
532 list of the constructor. (Early versions of `gcc` doesn't force you to
533 initialize the const member. It's a bug that has been fixed in `gcc 4`.)
Google Code Exporter642acbd2015-07-28 11:15:35 -0400534
Gennadiy Civil54379262018-07-17 17:47:25 -0400535## Why does ASSERT_DEATH complain about previous threads that were already joined?
Google Code Exporter642acbd2015-07-28 11:15:35 -0400536
Gennadiy Civil54379262018-07-17 17:47:25 -0400537With the Linux pthread library, there is no turning back once you cross the line
Ashik Paulc4a5ee32020-07-11 12:13:05 +0530538from a single thread to multiple threads. The first time you create a thread, a
Gennadiy Civil54379262018-07-17 17:47:25 -0400539manager thread is created in addition, so you get 3, not 2, threads. Later when
540the thread you create joins the main thread, the thread count decrements by 1,
541but the manager thread will never be killed, so you still have 2 threads, which
542means you cannot safely run a death test.
Google Code Exporter642acbd2015-07-28 11:15:35 -0400543
544The new NPTL thread library doesn't suffer from this problem, as it doesn't
545create a manager thread. However, if you don't control which machine your test
546runs on, you shouldn't depend on this.
547
Abseil Teamcf942a52022-05-25 19:16:56 -0700548## Why does GoogleTest require the entire test suite, instead of individual tests, to be named *DeathTest when it uses ASSERT_DEATH?
Google Code Exporter642acbd2015-07-28 11:15:35 -0400549
Abseil Teamcf942a52022-05-25 19:16:56 -0700550GoogleTest does not interleave tests from different test suites. That is, it
Gennadiy Civil834dff32019-06-24 11:16:58 -0400551runs all tests in one test suite first, and then runs all tests in the next test
Abseil Teamcf942a52022-05-25 19:16:56 -0700552suite, and so on. GoogleTest does this because it needs to set up a test suite
Ashik Paulc4a5ee32020-07-11 12:13:05 +0530553before the first test in it is run, and tear it down afterwards. Splitting up
Gennadiy Civil834dff32019-06-24 11:16:58 -0400554the test case would require multiple set-up and tear-down processes, which is
555inefficient and makes the semantics unclean.
Google Code Exporter642acbd2015-07-28 11:15:35 -0400556
557If we were to determine the order of tests based on test name instead of test
558case name, then we would have a problem with the following situation:
559
Gennadiy Civil3847aec2018-06-13 14:29:26 -0400560```c++
Google Code Exporter642acbd2015-07-28 11:15:35 -0400561TEST_F(FooTest, AbcDeathTest) { ... }
562TEST_F(FooTest, Uvw) { ... }
563
564TEST_F(BarTest, DefDeathTest) { ... }
565TEST_F(BarTest, Xyz) { ... }
566```
567
568Since `FooTest.AbcDeathTest` needs to run before `BarTest.Xyz`, and we don't
Gennadiy Civil834dff32019-06-24 11:16:58 -0400569interleave tests from different test suites, we need to run all tests in the
Google Code Exporter642acbd2015-07-28 11:15:35 -0400570`FooTest` case before running any test in the `BarTest` case. This contradicts
571with the requirement to run `BarTest.DefDeathTest` before `FooTest.Uvw`.
572
Gennadiy Civil834dff32019-06-24 11:16:58 -0400573## But I don't like calling my entire test suite \*DeathTest when it contains both death tests and non-death tests. What do I do?
Google Code Exporter642acbd2015-07-28 11:15:35 -0400574
Gennadiy Civil834dff32019-06-24 11:16:58 -0400575You don't have to, but if you like, you may split up the test suite into
Google Code Exporter642acbd2015-07-28 11:15:35 -0400576`FooTest` and `FooDeathTest`, where the names make it clear that they are
577related:
578
Gennadiy Civil3847aec2018-06-13 14:29:26 -0400579```c++
Google Code Exporter642acbd2015-07-28 11:15:35 -0400580class FooTest : public ::testing::Test { ... };
581
582TEST_F(FooTest, Abc) { ... }
583TEST_F(FooTest, Def) { ... }
584
Gennadiy Civil54379262018-07-17 17:47:25 -0400585using FooDeathTest = FooTest;
Google Code Exporter642acbd2015-07-28 11:15:35 -0400586
587TEST_F(FooDeathTest, Uvw) { ... EXPECT_DEATH(...) ... }
588TEST_F(FooDeathTest, Xyz) { ... ASSERT_DEATH(...) ... }
589```
590
Abseil Teamcf942a52022-05-25 19:16:56 -0700591## GoogleTest prints the LOG messages in a death test's child process only when the test fails. How can I see the LOG messages when the death test succeeds?
Gennadiy Civil54379262018-07-17 17:47:25 -0400592
593Printing the LOG messages generated by the statement inside `EXPECT_DEATH()`
594makes it harder to search for real problems in the parent's log. Therefore,
Abseil Teamcf942a52022-05-25 19:16:56 -0700595GoogleTest only prints them when the death test has failed.
Gennadiy Civil54379262018-07-17 17:47:25 -0400596
597If you really need to see such LOG messages, a workaround is to temporarily
598break the death test (e.g. by changing the regex pattern it is expected to
599match). Admittedly, this is a hack. We'll consider a more permanent solution
600after the fork-and-exec-style death tests are implemented.
601
Abseil Team1a5a78b2021-02-11 20:50:30 -0500602## The compiler complains about `no match for 'operator<<'` when I use an assertion. What gives?
Google Code Exporter642acbd2015-07-28 11:15:35 -0400603
604If you use a user-defined type `FooType` in an assertion, you must make sure
605there is an `std::ostream& operator<<(std::ostream&, const FooType&)` function
606defined such that we can print a value of `FooType`.
607
608In addition, if `FooType` is declared in a name space, the `<<` operator also
Abseil Team1a5a78b2021-02-11 20:50:30 -0500609needs to be defined in the *same* name space. See
610[Tip of the Week #49](http://abseil.io/tips/49) for details.
Google Code Exporter642acbd2015-07-28 11:15:35 -0400611
Gennadiy Civil54379262018-07-17 17:47:25 -0400612## How do I suppress the memory leak messages on Windows?
Google Code Exporter642acbd2015-07-28 11:15:35 -0400613
Abseil Teamcf942a52022-05-25 19:16:56 -0700614Since the statically initialized GoogleTest singleton requires allocations on
Google Code Exporter642acbd2015-07-28 11:15:35 -0400615the heap, the Visual C++ memory leak detector will report memory leaks at the
616end of the program run. The easiest way to avoid this is to use the
617`_CrtMemCheckpoint` and `_CrtMemDumpAllObjectsSince` calls to not report any
618statically initialized heap objects. See MSDN for more details and additional
619heap check/debug routines.
620
Gennadiy Civil54379262018-07-17 17:47:25 -0400621## How can my code detect if it is running in a test?
Google Code Exporter642acbd2015-07-28 11:15:35 -0400622
Gennadiy Civil54379262018-07-17 17:47:25 -0400623If you write code that sniffs whether it's running in a test and does different
624things accordingly, you are leaking test-only logic into production code and
625there is no easy way to ensure that the test-only code paths aren't run by
626mistake in production. Such cleverness also leads to
627[Heisenbugs](https://en.wikipedia.org/wiki/Heisenbug). Therefore we strongly
Abseil Teamcf942a52022-05-25 19:16:56 -0700628advise against the practice, and GoogleTest doesn't provide a way to do it.
Google Code Exporter642acbd2015-07-28 11:15:35 -0400629
Gennadiy Civil54379262018-07-17 17:47:25 -0400630In general, the recommended way to cause the code to behave differently under
Abseil Team1a5a78b2021-02-11 20:50:30 -0500631test is [Dependency Injection](http://en.wikipedia.org/wiki/Dependency_injection). You can inject
Gennadiy Civil54379262018-07-17 17:47:25 -0400632different functionality from the test and from the production code. Since your
633production code doesn't link in the for-test logic at all (the
Abseil Team1a5a78b2021-02-11 20:50:30 -0500634[`testonly`](http://docs.bazel.build/versions/master/be/common-definitions.html#common.testonly) attribute for BUILD targets helps to ensure
Gennadiy Civil834dff32019-06-24 11:16:58 -0400635that), there is no danger in accidentally running it.
Google Code Exporter642acbd2015-07-28 11:15:35 -0400636
Gennadiy Civil54379262018-07-17 17:47:25 -0400637However, if you *really*, *really*, *really* have no choice, and if you follow
638the rule of ending your test program names with `_test`, you can use the
639*horrible* hack of sniffing your executable name (`argv[0]` in `main()`) to know
640whether the code is under test.
Google Code Exporter642acbd2015-07-28 11:15:35 -0400641
Gennadiy Civil54379262018-07-17 17:47:25 -0400642## How do I temporarily disable a test?
643
644If you have a broken test that you cannot fix right away, you can add the
Abseil Team66836f02021-03-24 18:20:36 -0700645`DISABLED_` prefix to its name. This will exclude it from execution. This is
646better than commenting out the code or using `#if 0`, as disabled tests are
647still compiled (and thus won't rot).
Gennadiy Civil54379262018-07-17 17:47:25 -0400648
649To include disabled tests in test execution, just invoke the test program with
Abseil Team66836f02021-03-24 18:20:36 -0700650the `--gtest_also_run_disabled_tests` flag.
Gennadiy Civil54379262018-07-17 17:47:25 -0400651
652## Is it OK if I have two separate `TEST(Foo, Bar)` test methods defined in different namespaces?
Google Code Exporter642acbd2015-07-28 11:15:35 -0400653
654Yes.
655
Gennadiy Civil834dff32019-06-24 11:16:58 -0400656The rule is **all test methods in the same test suite must use the same fixture
Gennadiy Civil54379262018-07-17 17:47:25 -0400657class.** This means that the following is **allowed** because both tests use the
658same fixture class (`::testing::Test`).
Google Code Exporter642acbd2015-07-28 11:15:35 -0400659
Gennadiy Civil6a484ba2018-06-13 14:26:24 -0400660```c++
Google Code Exporter642acbd2015-07-28 11:15:35 -0400661namespace foo {
662TEST(CoolTest, DoSomething) {
663 SUCCEED();
664}
665} // namespace foo
666
667namespace bar {
668TEST(CoolTest, DoSomething) {
669 SUCCEED();
670}
Herbert Thielen14cf7f52017-08-31 16:10:36 +0200671} // namespace bar
Google Code Exporter642acbd2015-07-28 11:15:35 -0400672```
673
Gennadiy Civil54379262018-07-17 17:47:25 -0400674However, the following code is **not allowed** and will produce a runtime error
Abseil Teamcf942a52022-05-25 19:16:56 -0700675from GoogleTest because the test methods are using different test fixture
Gennadiy Civil834dff32019-06-24 11:16:58 -0400676classes with the same test suite name.
Google Code Exporter642acbd2015-07-28 11:15:35 -0400677
Gennadiy Civil6a484ba2018-06-13 14:26:24 -0400678```c++
Google Code Exporter642acbd2015-07-28 11:15:35 -0400679namespace foo {
680class CoolTest : public ::testing::Test {}; // Fixture foo::CoolTest
681TEST_F(CoolTest, DoSomething) {
682 SUCCEED();
683}
684} // namespace foo
685
686namespace bar {
687class CoolTest : public ::testing::Test {}; // Fixture: bar::CoolTest
688TEST_F(CoolTest, DoSomething) {
689 SUCCEED();
690}
Herbert Thielen14cf7f52017-08-31 16:10:36 +0200691} // namespace bar
Google Code Exporter642acbd2015-07-28 11:15:35 -0400692```