Get number of documents in a big collection in Cloud FirestoreHow to get a count of number of documents in a collection with Cloud FirestoreNodejs, Cloud Firestore Upload Tasks - Auth error:Error: socket hang upAccess a cloud firestore document within a cloud functionFirestore - Get document collectionsGet/add Document in Cloud functions using FirestoreIs it possible to get all documents in a Firestore Cloud Function?firestore cloud functions for getting aggregated values in collectionHow to count documents in cloud firestore?Getting document ID in Firebase Cloud Functions (Firestore)How to get documents with an array that contains a string? Cloud Firestore & Cloud Functions
Why can't we play rap on piano?
What reasons are there for a Capitalist to oppose a 100% inheritance tax?
Is "remove commented out code" correct English?
Do UK voters know if their MP will be the Speaker of the House?
Would Slavery Reparations be considered Bills of Attainder and hence Illegal?
How dangerous is XSS?
How to prevent "they're falling in love" trope
What are some good books on Machine Learning and AI like Krugman, Wells and Graddy's "Essentials of Economics"
iPad being using in wall mount battery swollen
What do you call someone who asks many questions?
Is there a hemisphere-neutral way of specifying a season?
One verb to replace 'be a member of' a club
A category-like structure without composition?
Intersection Puzzle
How do I deal with an unproductive colleague in a small company?
Solving a recurrence relation (poker chips)
What is the most common color to indicate the input-field is disabled?
What does “the session was packed” mean in this context?
How do conventional missiles fly?
In 'Revenger,' what does 'cove' come from?
How can I deal with my CEO asking me to hire someone with a higher salary than me, a co-founder?
Can we compute the area of a quadrilateral with one right angle when we only know the lengths of any three sides?
Avoiding direct proof while writing proof by induction
How do I handle a potential work/personal life conflict as the manager of one of my friends?
Get number of documents in a big collection in Cloud Firestore
How to get a count of number of documents in a collection with Cloud FirestoreNodejs, Cloud Firestore Upload Tasks - Auth error:Error: socket hang upAccess a cloud firestore document within a cloud functionFirestore - Get document collectionsGet/add Document in Cloud functions using FirestoreIs it possible to get all documents in a Firestore Cloud Function?firestore cloud functions for getting aggregated values in collectionHow to count documents in cloud firestore?Getting document ID in Firebase Cloud Functions (Firestore)How to get documents with an array that contains a string? Cloud Firestore & Cloud Functions
I know this question was already asked but I'm being specific about my case: I've got a large database (approximately 1 million documents inside the collection users).
I wanna get the exact number of documents inside users. I'm trying this:
export const count_users = functions.https.onRequest((request, response) =>
corsHandler(request, response, () =>
db.collection('users').select().get().then(
(snapshot) => response.json(snapshot.docs.length)
)
.catch(function(error)
console.error("[count_users] Error counting users: ", error);
response.json("Failed");
);
);
);
Although it seems right, it takes forever to give me a result. I'm not allowed to add or remove documents from the database.
Is there any possible approach for getting this quantity?
google-cloud-firestore google-cloud-functions
|
show 2 more comments
I know this question was already asked but I'm being specific about my case: I've got a large database (approximately 1 million documents inside the collection users).
I wanna get the exact number of documents inside users. I'm trying this:
export const count_users = functions.https.onRequest((request, response) =>
corsHandler(request, response, () =>
db.collection('users').select().get().then(
(snapshot) => response.json(snapshot.docs.length)
)
.catch(function(error)
console.error("[count_users] Error counting users: ", error);
response.json("Failed");
);
);
);
Although it seems right, it takes forever to give me a result. I'm not allowed to add or remove documents from the database.
Is there any possible approach for getting this quantity?
google-cloud-firestore google-cloud-functions
I don't think your case is any different than the other cases for counting documents in a collection. What's unique here?
– Doug Stevenson
Mar 21 at 22:24
I'm specifying that my collection is very large and that I'm not allowed to add or remove documents from it (and this seems to be a requirement for the solutions out there).
– Daniel
Mar 21 at 22:27
If the collection can't change size by adding or removing documents, why do you need to query it at all? Just use the known size.
– Doug Stevenson
Mar 21 at 22:28
This is the problem, I don't know the size. I uploaded 1 million documents but the cloud functions logs told me that some of the adding operations failed and I can't be sure there are actually 1 million documents at all. I need to make sure that nothing is missing.
– Daniel
Mar 21 at 22:30
1
1) increase the timeout on the function to max 9 minutes. or 2) Don't run it in Cloud Functions; run it in a Cloud shell instead, or even your desktop.
– Doug Stevenson
Mar 21 at 22:44
|
show 2 more comments
I know this question was already asked but I'm being specific about my case: I've got a large database (approximately 1 million documents inside the collection users).
I wanna get the exact number of documents inside users. I'm trying this:
export const count_users = functions.https.onRequest((request, response) =>
corsHandler(request, response, () =>
db.collection('users').select().get().then(
(snapshot) => response.json(snapshot.docs.length)
)
.catch(function(error)
console.error("[count_users] Error counting users: ", error);
response.json("Failed");
);
);
);
Although it seems right, it takes forever to give me a result. I'm not allowed to add or remove documents from the database.
Is there any possible approach for getting this quantity?
google-cloud-firestore google-cloud-functions
I know this question was already asked but I'm being specific about my case: I've got a large database (approximately 1 million documents inside the collection users).
I wanna get the exact number of documents inside users. I'm trying this:
export const count_users = functions.https.onRequest((request, response) =>
corsHandler(request, response, () =>
db.collection('users').select().get().then(
(snapshot) => response.json(snapshot.docs.length)
)
.catch(function(error)
console.error("[count_users] Error counting users: ", error);
response.json("Failed");
);
);
);
Although it seems right, it takes forever to give me a result. I'm not allowed to add or remove documents from the database.
Is there any possible approach for getting this quantity?
google-cloud-firestore google-cloud-functions
google-cloud-firestore google-cloud-functions
asked Mar 21 at 21:15
DanielDaniel
1,160721
1,160721
I don't think your case is any different than the other cases for counting documents in a collection. What's unique here?
– Doug Stevenson
Mar 21 at 22:24
I'm specifying that my collection is very large and that I'm not allowed to add or remove documents from it (and this seems to be a requirement for the solutions out there).
– Daniel
Mar 21 at 22:27
If the collection can't change size by adding or removing documents, why do you need to query it at all? Just use the known size.
– Doug Stevenson
Mar 21 at 22:28
This is the problem, I don't know the size. I uploaded 1 million documents but the cloud functions logs told me that some of the adding operations failed and I can't be sure there are actually 1 million documents at all. I need to make sure that nothing is missing.
– Daniel
Mar 21 at 22:30
1
1) increase the timeout on the function to max 9 minutes. or 2) Don't run it in Cloud Functions; run it in a Cloud shell instead, or even your desktop.
– Doug Stevenson
Mar 21 at 22:44
|
show 2 more comments
I don't think your case is any different than the other cases for counting documents in a collection. What's unique here?
– Doug Stevenson
Mar 21 at 22:24
I'm specifying that my collection is very large and that I'm not allowed to add or remove documents from it (and this seems to be a requirement for the solutions out there).
– Daniel
Mar 21 at 22:27
If the collection can't change size by adding or removing documents, why do you need to query it at all? Just use the known size.
– Doug Stevenson
Mar 21 at 22:28
This is the problem, I don't know the size. I uploaded 1 million documents but the cloud functions logs told me that some of the adding operations failed and I can't be sure there are actually 1 million documents at all. I need to make sure that nothing is missing.
– Daniel
Mar 21 at 22:30
1
1) increase the timeout on the function to max 9 minutes. or 2) Don't run it in Cloud Functions; run it in a Cloud shell instead, or even your desktop.
– Doug Stevenson
Mar 21 at 22:44
I don't think your case is any different than the other cases for counting documents in a collection. What's unique here?
– Doug Stevenson
Mar 21 at 22:24
I don't think your case is any different than the other cases for counting documents in a collection. What's unique here?
– Doug Stevenson
Mar 21 at 22:24
I'm specifying that my collection is very large and that I'm not allowed to add or remove documents from it (and this seems to be a requirement for the solutions out there).
– Daniel
Mar 21 at 22:27
I'm specifying that my collection is very large and that I'm not allowed to add or remove documents from it (and this seems to be a requirement for the solutions out there).
– Daniel
Mar 21 at 22:27
If the collection can't change size by adding or removing documents, why do you need to query it at all? Just use the known size.
– Doug Stevenson
Mar 21 at 22:28
If the collection can't change size by adding or removing documents, why do you need to query it at all? Just use the known size.
– Doug Stevenson
Mar 21 at 22:28
This is the problem, I don't know the size. I uploaded 1 million documents but the cloud functions logs told me that some of the adding operations failed and I can't be sure there are actually 1 million documents at all. I need to make sure that nothing is missing.
– Daniel
Mar 21 at 22:30
This is the problem, I don't know the size. I uploaded 1 million documents but the cloud functions logs told me that some of the adding operations failed and I can't be sure there are actually 1 million documents at all. I need to make sure that nothing is missing.
– Daniel
Mar 21 at 22:30
1
1
1) increase the timeout on the function to max 9 minutes. or 2) Don't run it in Cloud Functions; run it in a Cloud shell instead, or even your desktop.
– Doug Stevenson
Mar 21 at 22:44
1) increase the timeout on the function to max 9 minutes. or 2) Don't run it in Cloud Functions; run it in a Cloud shell instead, or even your desktop.
– Doug Stevenson
Mar 21 at 22:44
|
show 2 more comments
0
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55289361%2fget-number-of-documents-in-a-big-collection-in-cloud-firestore%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55289361%2fget-number-of-documents-in-a-big-collection-in-cloud-firestore%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
I don't think your case is any different than the other cases for counting documents in a collection. What's unique here?
– Doug Stevenson
Mar 21 at 22:24
I'm specifying that my collection is very large and that I'm not allowed to add or remove documents from it (and this seems to be a requirement for the solutions out there).
– Daniel
Mar 21 at 22:27
If the collection can't change size by adding or removing documents, why do you need to query it at all? Just use the known size.
– Doug Stevenson
Mar 21 at 22:28
This is the problem, I don't know the size. I uploaded 1 million documents but the cloud functions logs told me that some of the adding operations failed and I can't be sure there are actually 1 million documents at all. I need to make sure that nothing is missing.
– Daniel
Mar 21 at 22:30
1
1) increase the timeout on the function to max 9 minutes. or 2) Don't run it in Cloud Functions; run it in a Cloud shell instead, or even your desktop.
– Doug Stevenson
Mar 21 at 22:44