Timeline for Memory efficient filtering with scipy.signal in Python
Current License: CC BY-SA 4.0
7 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Apr 9, 2021 at 15:59 | vote | accept | hvta | ||
| Mar 21, 2021 at 23:54 | comment | added | Dan Boschen | I would create my own FIR filter as a generator object in which you pass in a file object (which is an iterator) and write the output stream to a file. This approach is both simple once constructed and can stream indefinitely up to the limit of the file storage space available. | |
| Mar 21, 2021 at 22:56 | comment | added | endolith | @TimWescott Yeah I assume both in and out arrays would be mmap | |
| Mar 21, 2021 at 19:01 | comment | added | TimWescott | I would figure out how to read the file in chunks, and write it out in chucks. You should only need to keep two input and two output chunks in memory at a time. | |
| Mar 21, 2021 at 18:06 | comment | added | endolith |
(I'm not sure about np.nditer. "The nditer will try to provide chunks that are as large as possible to the inner loop." But I don't know what "as large as possible" means.)
|
|
| Mar 21, 2021 at 18:00 | history | edited | endolith | CC BY-SA 4.0 |
added 173 characters in body
|
| Mar 21, 2021 at 17:45 | history | answered | endolith | CC BY-SA 4.0 |