The first question you probably have is: how many posts and comments can I gather overall?
- The only limitation to the number of posts and comments you can gather is related to how many Phoenix credits you have left in your project – we discuss that limitation here.
- You can cap the number of posts and comments you want to gather if you have a reason to do so (e.g. you just want a smaller selection to work with).
- Other than that, there is no cap to the number of posts or the number of comments that can be gathered, but sometimes the data collection will time out and you will get some incomplete data. We try our best to monitor the data collection process so this doesn’t happen too often.
<aside>
💡 If you think there is data missing from a gather you run on the Phoenix platform, please get in touch to discuss this with us at [email protected]
</aside>
With that said, there are limitations to what we can gather, and these are different for each social media platform, which are discussed below.
<aside>
➡️
One limitation applies to all platforms: we only collect data from public accounts; we never collect data from private accounts.
</aside>
Platform |
What type of data? |
How can I get data? |
Details & limitations |
Facebook |
Posts & comments |
List of accounts or keywords |
See here |
TikTok |
Video description & comments |
List of accounts, hashtags or keywords |
See here |
<aside>
🗣
We will be adding gather options for X / Twitter, YouTube, Telegram and Instagram in 2025. In the meantime, if you have a way to get social media data on your own, you can use the manual upload function to bring it into the Phoenix platform. Find out how here:
Manual Upload for Social Media Data
</aside>
<aside>
<img src="/icons/thought-dialogue_blue.svg" alt="/icons/thought-dialogue_blue.svg" width="40px" />
We have noticed that some people confuse a gather that uses keywords with a classifier that uses keywords. Here are some ways to help you distinguish:
- A gather collects data; a classifier applies a class (or label) to the data you have collected.
- You do not collect any new data when you apply a keyword classifier, you simply apply a label to each bit of data you already have collected that contains the keywords.
- If you gather data from a list of accounts and then you apply a keyword classifier to that data, you will find out when the accounts in your list post using the keywords you defined in your classifier. For example, when does the Build Up Facebook page post the word “peacebuilding”?
</aside>
Facebook gather
Phoenix has three ways to collect data from Facebook.
- Facebook posts from a list of accounts:
- You will need a list of accounts (public pages or groups; no private accounts) that you want to collect posts from. This is relevant if you are interested in understanding what certain people or institutions are sharing on Facebook.
- You will be able to select the date range for posts (going as far back as you want) as well as the maximum number of posts you want to collect from each account (you can set this as high as you want).
- Facebook posts from a list of keywords:
- You will need a list of keywords or phrases that you want to appear in the posts you collect. This is relevant if you are interested in understanding a topic.
- If you enter more than one keyword, the search will find posts that contain all of them. For example, a gather for
junk food
would look for posts containing both words.
- If you want to run a gather that contains either
junk
or food
, then you will need to create two separate gathers: one for food
and one for junk
- You cannot search for posts in a specific period of time; you will collect the most recent posts, and you can set the maximum number of posts you want to collect.
- You will not get the number of shares for posts collected in this way.
- The “country of search” option does not give you the geolocation of the post. That is, even if you set it to “USA” it may still show you posts from Germany. However, it is useful to set the country of search to the location you are most interested in as you will likely get better results.
- Facebook comments from a list of Facebook posts:
- You can collect Facebook comments from a list of Facebook posts. IMPORTANT: Phoenix will only show you comments for posts you have already gathered. The best way to do this is to:
- Run a gather for Facebook posts (using accounts or keywords)
- Find the Facebook posts you want comments from, using the Explore tab
- Then run a gather for the comments on those Facebook posts
- You can decide how many comments you want from each post, whether you want to collect the most relevant or the most recent, and whether you want to include replies to comments. Note that due to restrictions by Meta, we are only able to collect 10 comments per post plus their replies.
TikTok gather
Phoenix has the ability to collect the text description of TikTok videos (which we call “posts”) and comments from public accounts. We do not collect the video itself, but we do collect the link to the video (so you can go to it easily). Phoenix has four ways to collect data from TikTok.
- TikTok posts from a list of accounts:
- You will need a list of accounts (public accounts; no private accounts) that you want to collect videos from. This is relevant if you are interested in understanding what certain people or institutions are sharing on TikTok.
- You will be able to select the date range for videos (going as far back as you want) and the number of videos you’d like to collect from each user/ account.
- The “country to gather from” option does not give you the geolocation of the post. That is, even if you set it to “USA” it may still show you posts from Germany. However, it is useful to set the country of search to the location you are most interested in as you will likely get better results.
- TikTok posts from a list of keywords:
- You will need a list of keywords or phrases that you want to appear in the posts you collect. This is relevant if you are interested in understanding a topic.
- It is possible to add a phrase as a keyword, for example,
junk food
. If you add a phrase, the search will find posts that contain all of the keywords. For example, a gather for junk food
would look for posts containing both words.
- If you want to run a gather that contains either
junk
or food
, then you will need to add two separate keyword inputs: one for food
and one for junk
.
- You can also use a new line or comma to seperate phrase inputs. For example, if you type “junk food, healthy food” then you will gather post that contain either “junk food” or “healthy food”
- You cannot search for keywords in a specific period of time; you will collect the most recent posts using the keywords, and you can set the maximum number of posts/ videos you want to collect.
- The “country to gather from” option does not give you the geolocation of the post. That is, even if you set it to “USA” it may still show you posts from Germany. However, it is useful to set the country of search to the location you are most interested in as you will likely get better results.
- TikTok posts from a list of hashtags:
- You will need a list of hashtags that you want to appear in the posts you collect. This is relevant if you are interested in understanding a topic.
- If you want to run a gather that contains either #junkfood or #healthyfood, then you can use a new line or comma to separate hashtag inputs.
- You cannot search for hashtags in a specific period of time; you will collect the most recent posts using the hashtags, and you can set the maximum number of posts/ videos you want to collect.
- The “country to gather from” option does not give you the geolocation of the post. That is, even if you set it to “USA” it may still show you posts from Germany. However, it is useful to set the country of search to the location you are most interested in as you will likely get better results.
- TikTok comments from a list of TikTok posts:
- You can collect TikTok comments from a list of TikTok posts. IMPORTANT: Phoenix will only show you comments for posts you have already gathered. The best way to do this is to:
- Run a gather for TikTok posts (using accounts, keywords or hashtags)
- Find the TikTok posts you want comments from, using the Explore tab
- Then run a gather for the comments on those TikTok posts
- You can decide how many comments you want from each post.