Styjun

What details should I consider before agreeing for part of my salary to be 'retained' by employer?

Operation Unzalgo

Why do space operations use "nominal" to mean "working correctly"?

Redirect if userid is not found in a database table

Does this sentence I constructed with my junior high school latin work? I write online advertising and want to come off as snobby as possible

Is it rude to refer to janitors as 'floor people'?

Is the Münchhausen trilemma really a trilemma?

When can a polynomial be written as a polynomial function of another polynomial?

Did 007 exist before James Bond?

Are there any restrictions on how amendment should be related to original law in US Senate?

"Je suis petite, moi?", purpose of the "moi"?

Strategy to pay off revolving debt while building reserve savings fund?

Change Opacity of Style

Whipping heavy cream with melted chocolate

Locked-up DOS computer beeped on keypress. What mechanism caused that?

How can electric field be defined as force per charge, if the charge makes its own, singular electric field?

Grouping into more groups in one iteration

What was the difference between a Games Console and a Home Computer?

Practical example in using (homotopy) type theory

Is Error correction and detection can be done with out adding extra bits?

Exporting animation to Unity

How to remove the first colon ':' from a timestamp?

''Habitable'' planet close to a star

How can one convert an expression to a string while keeping the quotation marks of strings that are part of the expression?

Logging to a single file in a project that spawns and destroys multiple child processes?

node.js multiprocess loggingHow do I plug into socket.io's built in logging system to generate my own messages?SLF4J logging to file vs. DB vs. SolrOutput PID to file from process executed in bash script?Log the reason for process termination with C++ on LinuxWhy not use java.util.logging?node.js child process - difference between spawn & forkLogstash Multiple Log FormatsHow-To: Python TimedRotatingFileHandle for multiple process-instances and files?Single or Multiple logger instance in a web projectLog js file name and function name

.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty margin-bottom:0;

0

The way the current logging works is we're using Winston to log to a file using the PID as part of the filename, as a result we end up with 10,000+ log files per day (a lot of processes are created and destroyed).

I was thinking of having a single socket server where log calls are sent and handles logging everything from all processes to a single file per type of log level. However, I've read that this could cause a bottleneck?

Just looking for some guidance, I've done some searching but can't find what I'm looking for.

node.js asynchronous logging process

share|improve this question

asked Mar 26 at 9:47

JDodgerJDodger

1

• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  Maybe you should add details, it's hard to answer you with precision. One thing though, how do you plan to handle concurrent access to the "single file per type of log level" if different processes try to write at the same time?
  
  – Kaddath
  Mar 26 at 9:51
  

  
  
  
  


• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  I was planning on using a queue for each log level, when a process sends a log request it gets added to the back of the queue. Logs then get written to the corresponding file one at a time from the front of the queue. What other details would be good?
  
  – JDodger
  Mar 26 at 9:55
  

  
  
  
  


• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  That seems fine, now where do you expect "that this could cause a bottleneck"? Additionnally, it could be useful to know where you read it
  
  – Kaddath
  Mar 26 at 10:08
  

  
  
  
  


• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  The answer to this question: stackoverflow.com/questions/23339732/… I don't fully understand the answer, but also don't want to use that package.
  
  – JDodger
  Mar 26 at 10:34
  

  
  
  
  

add a comment | 

0

The way the current logging works is we're using Winston to log to a file using the PID as part of the filename, as a result we end up with 10,000+ log files per day (a lot of processes are created and destroyed).

I was thinking of having a single socket server where log calls are sent and handles logging everything from all processes to a single file per type of log level. However, I've read that this could cause a bottleneck?

Just looking for some guidance, I've done some searching but can't find what I'm looking for.

node.js asynchronous logging process

share|improve this question

asked Mar 26 at 9:47

JDodgerJDodger

1

• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  Maybe you should add details, it's hard to answer you with precision. One thing though, how do you plan to handle concurrent access to the "single file per type of log level" if different processes try to write at the same time?
  
  – Kaddath
  Mar 26 at 9:51
  

  
  
  
  


• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  I was planning on using a queue for each log level, when a process sends a log request it gets added to the back of the queue. Logs then get written to the corresponding file one at a time from the front of the queue. What other details would be good?
  
  – JDodger
  Mar 26 at 9:55
  

  
  
  
  


• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  That seems fine, now where do you expect "that this could cause a bottleneck"? Additionnally, it could be useful to know where you read it
  
  – Kaddath
  Mar 26 at 10:08
  

  
  
  
  


• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  The answer to this question: stackoverflow.com/questions/23339732/… I don't fully understand the answer, but also don't want to use that package.
  
  – JDodger
  Mar 26 at 10:34
  

  
  
  
  

add a comment | 

The way the current logging works is we're using Winston to log to a file using the PID as part of the filename, as a result we end up with 10,000+ log files per day (a lot of processes are created and destroyed).

I was thinking of having a single socket server where log calls are sent and handles logging everything from all processes to a single file per type of log level. However, I've read that this could cause a bottleneck?

Just looking for some guidance, I've done some searching but can't find what I'm looking for.

node.js asynchronous logging process

share|improve this question

asked Mar 26 at 9:47

JDodgerJDodger

1

share|improve this question

asked Mar 26 at 9:47

JDodgerJDodger

1

share|improve this question

asked Mar 26 at 9:47

JDodgerJDodger

1

asked Mar 26 at 9:47

JDodgerJDodger

1

asked Mar 26 at 9:47

JDodgerJDodger

1