Get number of documents in a big collection in Cloud FirestoreHow to get a count of number of documents in a collection with Cloud FirestoreNodejs, Cloud Firestore Upload Tasks - Auth error:Error: socket hang upAccess a cloud firestore document within a cloud functionFirestore - Get document collectionsGet/add Document in Cloud functions using FirestoreIs it possible to get all documents in a Firestore Cloud Function?firestore cloud functions for getting aggregated values in collectionHow to count documents in cloud firestore?Getting document ID in Firebase Cloud Functions (Firestore)How to get documents with an array that contains a string? Cloud Firestore & Cloud Functions

Why can't we play rap on piano?

What reasons are there for a Capitalist to oppose a 100% inheritance tax?

Is "remove commented out code" correct English?

Do UK voters know if their MP will be the Speaker of the House?

Would Slavery Reparations be considered Bills of Attainder and hence Illegal?

How dangerous is XSS?

How to prevent "they're falling in love" trope

What are some good books on Machine Learning and AI like Krugman, Wells and Graddy's "Essentials of Economics"

iPad being using in wall mount battery swollen

What do you call someone who asks many questions?

Is there a hemisphere-neutral way of specifying a season?

One verb to replace 'be a member of' a club

A category-like structure without composition?

Intersection Puzzle

How do I deal with an unproductive colleague in a small company?

Solving a recurrence relation (poker chips)

What is the most common color to indicate the input-field is disabled?

What does “the session was packed” mean in this context?

How do conventional missiles fly?

In 'Revenger,' what does 'cove' come from?

How can I deal with my CEO asking me to hire someone with a higher salary than me, a co-founder?

Can we compute the area of a quadrilateral with one right angle when we only know the lengths of any three sides?

Avoiding direct proof while writing proof by induction

How do I handle a potential work/personal life conflict as the manager of one of my friends?



Get number of documents in a big collection in Cloud Firestore


How to get a count of number of documents in a collection with Cloud FirestoreNodejs, Cloud Firestore Upload Tasks - Auth error:Error: socket hang upAccess a cloud firestore document within a cloud functionFirestore - Get document collectionsGet/add Document in Cloud functions using FirestoreIs it possible to get all documents in a Firestore Cloud Function?firestore cloud functions for getting aggregated values in collectionHow to count documents in cloud firestore?Getting document ID in Firebase Cloud Functions (Firestore)How to get documents with an array that contains a string? Cloud Firestore & Cloud Functions













1















I know this question was already asked but I'm being specific about my case: I've got a large database (approximately 1 million documents inside the collection users).



I wanna get the exact number of documents inside users. I'm trying this:



export const count_users = functions.https.onRequest((request, response) => 
corsHandler(request, response, () =>

db.collection('users').select().get().then(
(snapshot) => response.json(snapshot.docs.length)
)
.catch(function(error)
console.error("[count_users] Error counting users: ", error);
response.json("Failed");
);
);
);


Although it seems right, it takes forever to give me a result. I'm not allowed to add or remove documents from the database.



Is there any possible approach for getting this quantity?










share|improve this question






















  • I don't think your case is any different than the other cases for counting documents in a collection. What's unique here?

    – Doug Stevenson
    Mar 21 at 22:24











  • I'm specifying that my collection is very large and that I'm not allowed to add or remove documents from it (and this seems to be a requirement for the solutions out there).

    – Daniel
    Mar 21 at 22:27












  • If the collection can't change size by adding or removing documents, why do you need to query it at all? Just use the known size.

    – Doug Stevenson
    Mar 21 at 22:28












  • This is the problem, I don't know the size. I uploaded 1 million documents but the cloud functions logs told me that some of the adding operations failed and I can't be sure there are actually 1 million documents at all. I need to make sure that nothing is missing.

    – Daniel
    Mar 21 at 22:30







  • 1





    1) increase the timeout on the function to max 9 minutes. or 2) Don't run it in Cloud Functions; run it in a Cloud shell instead, or even your desktop.

    – Doug Stevenson
    Mar 21 at 22:44















1















I know this question was already asked but I'm being specific about my case: I've got a large database (approximately 1 million documents inside the collection users).



I wanna get the exact number of documents inside users. I'm trying this:



export const count_users = functions.https.onRequest((request, response) => 
corsHandler(request, response, () =>

db.collection('users').select().get().then(
(snapshot) => response.json(snapshot.docs.length)
)
.catch(function(error)
console.error("[count_users] Error counting users: ", error);
response.json("Failed");
);
);
);


Although it seems right, it takes forever to give me a result. I'm not allowed to add or remove documents from the database.



Is there any possible approach for getting this quantity?










share|improve this question






















  • I don't think your case is any different than the other cases for counting documents in a collection. What's unique here?

    – Doug Stevenson
    Mar 21 at 22:24











  • I'm specifying that my collection is very large and that I'm not allowed to add or remove documents from it (and this seems to be a requirement for the solutions out there).

    – Daniel
    Mar 21 at 22:27












  • If the collection can't change size by adding or removing documents, why do you need to query it at all? Just use the known size.

    – Doug Stevenson
    Mar 21 at 22:28












  • This is the problem, I don't know the size. I uploaded 1 million documents but the cloud functions logs told me that some of the adding operations failed and I can't be sure there are actually 1 million documents at all. I need to make sure that nothing is missing.

    – Daniel
    Mar 21 at 22:30







  • 1





    1) increase the timeout on the function to max 9 minutes. or 2) Don't run it in Cloud Functions; run it in a Cloud shell instead, or even your desktop.

    – Doug Stevenson
    Mar 21 at 22:44













1












1








1








I know this question was already asked but I'm being specific about my case: I've got a large database (approximately 1 million documents inside the collection users).



I wanna get the exact number of documents inside users. I'm trying this:



export const count_users = functions.https.onRequest((request, response) => 
corsHandler(request, response, () =>

db.collection('users').select().get().then(
(snapshot) => response.json(snapshot.docs.length)
)
.catch(function(error)
console.error("[count_users] Error counting users: ", error);
response.json("Failed");
);
);
);


Although it seems right, it takes forever to give me a result. I'm not allowed to add or remove documents from the database.



Is there any possible approach for getting this quantity?










share|improve this question














I know this question was already asked but I'm being specific about my case: I've got a large database (approximately 1 million documents inside the collection users).



I wanna get the exact number of documents inside users. I'm trying this:



export const count_users = functions.https.onRequest((request, response) => 
corsHandler(request, response, () =>

db.collection('users').select().get().then(
(snapshot) => response.json(snapshot.docs.length)
)
.catch(function(error)
console.error("[count_users] Error counting users: ", error);
response.json("Failed");
);
);
);


Although it seems right, it takes forever to give me a result. I'm not allowed to add or remove documents from the database.



Is there any possible approach for getting this quantity?







google-cloud-firestore google-cloud-functions






share|improve this question













share|improve this question











share|improve this question




share|improve this question










asked Mar 21 at 21:15









DanielDaniel

1,160721




1,160721












  • I don't think your case is any different than the other cases for counting documents in a collection. What's unique here?

    – Doug Stevenson
    Mar 21 at 22:24











  • I'm specifying that my collection is very large and that I'm not allowed to add or remove documents from it (and this seems to be a requirement for the solutions out there).

    – Daniel
    Mar 21 at 22:27












  • If the collection can't change size by adding or removing documents, why do you need to query it at all? Just use the known size.

    – Doug Stevenson
    Mar 21 at 22:28












  • This is the problem, I don't know the size. I uploaded 1 million documents but the cloud functions logs told me that some of the adding operations failed and I can't be sure there are actually 1 million documents at all. I need to make sure that nothing is missing.

    – Daniel
    Mar 21 at 22:30







  • 1





    1) increase the timeout on the function to max 9 minutes. or 2) Don't run it in Cloud Functions; run it in a Cloud shell instead, or even your desktop.

    – Doug Stevenson
    Mar 21 at 22:44

















  • I don't think your case is any different than the other cases for counting documents in a collection. What's unique here?

    – Doug Stevenson
    Mar 21 at 22:24











  • I'm specifying that my collection is very large and that I'm not allowed to add or remove documents from it (and this seems to be a requirement for the solutions out there).

    – Daniel
    Mar 21 at 22:27












  • If the collection can't change size by adding or removing documents, why do you need to query it at all? Just use the known size.

    – Doug Stevenson
    Mar 21 at 22:28












  • This is the problem, I don't know the size. I uploaded 1 million documents but the cloud functions logs told me that some of the adding operations failed and I can't be sure there are actually 1 million documents at all. I need to make sure that nothing is missing.

    – Daniel
    Mar 21 at 22:30







  • 1





    1) increase the timeout on the function to max 9 minutes. or 2) Don't run it in Cloud Functions; run it in a Cloud shell instead, or even your desktop.

    – Doug Stevenson
    Mar 21 at 22:44
















I don't think your case is any different than the other cases for counting documents in a collection. What's unique here?

– Doug Stevenson
Mar 21 at 22:24





I don't think your case is any different than the other cases for counting documents in a collection. What's unique here?

– Doug Stevenson
Mar 21 at 22:24













I'm specifying that my collection is very large and that I'm not allowed to add or remove documents from it (and this seems to be a requirement for the solutions out there).

– Daniel
Mar 21 at 22:27






I'm specifying that my collection is very large and that I'm not allowed to add or remove documents from it (and this seems to be a requirement for the solutions out there).

– Daniel
Mar 21 at 22:27














If the collection can't change size by adding or removing documents, why do you need to query it at all? Just use the known size.

– Doug Stevenson
Mar 21 at 22:28






If the collection can't change size by adding or removing documents, why do you need to query it at all? Just use the known size.

– Doug Stevenson
Mar 21 at 22:28














This is the problem, I don't know the size. I uploaded 1 million documents but the cloud functions logs told me that some of the adding operations failed and I can't be sure there are actually 1 million documents at all. I need to make sure that nothing is missing.

– Daniel
Mar 21 at 22:30






This is the problem, I don't know the size. I uploaded 1 million documents but the cloud functions logs told me that some of the adding operations failed and I can't be sure there are actually 1 million documents at all. I need to make sure that nothing is missing.

– Daniel
Mar 21 at 22:30





1




1





1) increase the timeout on the function to max 9 minutes. or 2) Don't run it in Cloud Functions; run it in a Cloud shell instead, or even your desktop.

– Doug Stevenson
Mar 21 at 22:44





1) increase the timeout on the function to max 9 minutes. or 2) Don't run it in Cloud Functions; run it in a Cloud shell instead, or even your desktop.

– Doug Stevenson
Mar 21 at 22:44












0






active

oldest

votes












Your Answer






StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");

StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);

else
createEditor();

);

function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);



);













draft saved

draft discarded


















StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55289361%2fget-number-of-documents-in-a-big-collection-in-cloud-firestore%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown

























0






active

oldest

votes








0






active

oldest

votes









active

oldest

votes






active

oldest

votes















draft saved

draft discarded
















































Thanks for contributing an answer to Stack Overflow!


  • Please be sure to answer the question. Provide details and share your research!

But avoid …


  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.

To learn more, see our tips on writing great answers.




draft saved


draft discarded














StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55289361%2fget-number-of-documents-in-a-big-collection-in-cloud-firestore%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown







Popular posts from this blog

How to preserve electronics (computers, tablets and phones) for hundreds of years Announcing the arrival of Valued Associate #679: Cesar Manara Planned maintenance scheduled April 23, 2019 at 23:30 UTC (7:30pm US/Eastern) The network's official Twitter account is up and running again. What content…How might modern humans leave a message for 50,000 years?How would an aquatic race develop computers?How do we make computers care for human life?Keeping supplies for 1000 yearsWhat will cell phones become in 100 years?What body armor protects against a laser?Could a society attain 1800s technology if limited to using copper and bronze?Electricity power (magic) and electronicsScavenging metal resources in post-apocalypse after 100 yearsWhy would precursors create devices that can survive and still work after hundreds of years?

155 수학 과학 기타 둘러보기 메뉴eh추가해eh문서를 완성해

Convert JSON to MapSimplest way to convert a string representing JSON array into Java array List of key value pairsHow to take String JSON values into HashMapConvert a JSON String to a HashMapCreating BSON object from JSON stringJSONObject - How to get a value ?Better Map ConstructorReading JSON from Url javaUpdate columns if input values are not null otherwise ignore and keep the existing values of column in databaseHow to store object represented as Json string into Couchbase Lite?Go JSON into MapHow do I efficiently iterate over each entry in a Java Map?Sort a Map<Key, Value> by valuesHow to round a number to n decimal places in JavaCan comments be used in JSON?How do I read / convert an InputStream into a String in Java?How can I pretty-print JSON in a shell script?What is the correct JSON content type?How can I deserialize JSON to a simple Dictionary<string,string> in ASP.NET?Why does Google prepend while(1); to their JSON responses?Parse JSON in JavaScript?