January 2024 - pacsat-dev - mailman.amsat.org

Faking Memory Size
by Bob Stricklin 16 Jan '24

16 Jan '24

You can see the file I edited and the change I made to make CCS build the project so I could see how much memory it used. This file and info is initially supplied by HCG. I am getting exact same information I see in Launchpad code and I see no reason for it to be much different. Bob

1 0

Memory File Linker
by Bob Stricklin 16 Jan '24

16 Jan '24

Burns, Tied up with doctors visit here earlier. Going to forward a couple of files related to this. I do not see a MAP file generated by the Linker. I feel there should be one some place. The only thing I see related to this is the Memory Allocation relating memory use to code routines. Using the same input of code here used by Launchpad and PacSatSW project with HCG changes. I plan to put my code on GitHub today. Have not tried to manually modify the Memory Map file. I have project set for automatic and my understanding is CCS does this for you. I will send a second email showing changes I made to make CCS think I had more memory and build project. Bob

1 0

Re: Memory Problem on PacSatSW
by Burns Fisher (AMSAT) 16 Jan '24

16 Jan '24

Just a reminder, Chris, that if you are using the OS heap (as gets used for stacks) reducing what you request will not reduce the memory that the linker sees being used. You have to also reduce the heap size. 73, Burns Fisher, WB1FJ *AMSAT(R) Engineering -- Flight Software* On Tue, Jan 16, 2024 at 11:38 AM Chris Thompson via pacsat-dev < pacsat-dev(a)amsat.org> wrote: > I expect the code could be drastically optimized to reduce memory usage. > It's fairly complex and I opted for simple static memory allocation. But > there is plenty of duplication. Each task makes a copy of the received > packet in an RTOS queue and likely in a temp buffer as well. In theory we > could collapse all of that into one shared queue/buffer. > > In the short term you can reduce the heap size as Burns said. You could > also remove some of the tasks temporarily as they each have a stack. The > stack sizes can also probably be trimmed back in some cases as no > optimization has been done. > > Most of the Globals are in MRAM but get mirrored in RAM. We could stop > doing that but I doubt it is a lot of space. > > Finally we keep an index of the directory in the heap which does increase > its size. We could remove that and only iterate over MRAM but that > requires some redesign as it needs to be sorted by upload time. > > 73 > Chris the > > > On Mon, Jan 15, 2024, 16:01 Bob Stricklin via pacsat-dev < > pacsat-dev(a)amsat.org> wrote: > >> Looks like we have an issue with memory usage in RAM. >> >> >> >> If you load up CCS with the current project PacSatSW and build it then >> you can select VIEW -> Memory Allocation and look at the tab. You will see >> the package needs 154K or RAM and the Launpad has 191K. In the case of the >> TMS570LS0914 we have 128K max. >> >> You can expand RAM and the subfolders and see where the memory is being >> used. >> >> >> >> I worked for the last few days getting a HalCoGen setup for the LS0914 >> and then murging this HCG file with the code of the Launcpad project. After >> working through some issues it built but when it ran the linker it errored >> out with not enough memory. So faked it out and told the linker I had more >> memory. Then it would build and generate a .out file and the Memory >> Allocation info. It matches the launch pad build. >> >> >> >> Probably need to look for ways to reduce RAM needed. Reduce buffer sizes, >> move buffers to external memory, or take out code. >> >> >> >> I will be looking for things here to try and complete a basic build of >> the code for the LS0914. Please look for ideas and post any that you come >> up with. We probably should target RAM usage at about 80% of the max or >> about 100KB. We could change processors later but that would need some >> study. >> >> >> >> Bob >> >> >> >> >> ----------------------------------------------------------- >> >> pacsat-dev mailing list -- pacsat-dev(a)amsat.org >> View archives of this mailing list at >> https://mailman.amsat.org/hyperkitty/list/[email protected] >> To unsubscribe send an email to pacsat-dev-leave(a)amsat.org >> Manage all of your AMSAT-NA mailing list preferences at >> https://mailman.amsat.org >> > > ----------------------------------------------------------- > > pacsat-dev mailing list -- pacsat-dev(a)amsat.org > View archives of this mailing list at > https://mailman.amsat.org/hyperkitty/list/[email protected] > To unsubscribe send an email to pacsat-dev-leave(a)amsat.org > Manage all of your AMSAT-NA mailing list preferences at > https://mailman.amsat.org >

1 0

Re: Memory Problem on PacSatSW
by Chris Thompson 16 Jan '24

16 Jan '24

I expect the code could be drastically optimized to reduce memory usage. It's fairly complex and I opted for simple static memory allocation. But there is plenty of duplication. Each task makes a copy of the received packet in an RTOS queue and likely in a temp buffer as well. In theory we could collapse all of that into one shared queue/buffer. In the short term you can reduce the heap size as Burns said. You could also remove some of the tasks temporarily as they each have a stack. The stack sizes can also probably be trimmed back in some cases as no optimization has been done. Most of the Globals are in MRAM but get mirrored in RAM. We could stop doing that but I doubt it is a lot of space. Finally we keep an index of the directory in the heap which does increase its size. We could remove that and only iterate over MRAM but that requires some redesign as it needs to be sorted by upload time. 73 Chris the On Mon, Jan 15, 2024, 16:01 Bob Stricklin via pacsat-dev < pacsat-dev(a)amsat.org> wrote: > Looks like we have an issue with memory usage in RAM. > > > > If you load up CCS with the current project PacSatSW and build it then you > can select VIEW -> Memory Allocation and look at the tab. You will see the > package needs 154K or RAM and the Launpad has 191K. In the case of the > TMS570LS0914 we have 128K max. > > You can expand RAM and the subfolders and see where the memory is being > used. > > > > I worked for the last few days getting a HalCoGen setup for the LS0914 and > then murging this HCG file with the code of the Launcpad project. After > working through some issues it built but when it ran the linker it errored > out with not enough memory. So faked it out and told the linker I had more > memory. Then it would build and generate a .out file and the Memory > Allocation info. It matches the launch pad build. > > > > Probably need to look for ways to reduce RAM needed. Reduce buffer sizes, > move buffers to external memory, or take out code. > > > > I will be looking for things here to try and complete a basic build of the > code for the LS0914. Please look for ideas and post any that you come up > with. We probably should target RAM usage at about 80% of the max or about > 100KB. We could change processors later but that would need some study. > > > > Bob > > > > > ----------------------------------------------------------- > > pacsat-dev mailing list -- pacsat-dev(a)amsat.org > View archives of this mailing list at > https://mailman.amsat.org/hyperkitty/list/[email protected] > To unsubscribe send an email to pacsat-dev-leave(a)amsat.org > Manage all of your AMSAT-NA mailing list preferences at > https://mailman.amsat.org >

1 0

Re: Memory Problem on PacSatSW
by Bob Stricklin 16 Jan '24

16 Jan '24

I am working with CCS version 12.5. Bob From: Jim McCullers via pacsat-dev <pacsat-dev(a)amsat.org> Sent: Monday, January 15, 2024 6:31 PM To: 'Pacsat Dev' <pacsat-dev(a)amsat.org> Subject: [pacsat-dev] Re: Memory Problem on PacSatSW My version of CSS is either different or how did you turn on the green lines with summary data? I get a popup status message with similar info but not as stable or detailed as yours. On my system, I'm showing 80% utilization. The majority is in ucHeap (about 131k). I'll bet on a function somewhere allocating a chunk of memory or repeatedly doing so and never using or releasing it. Should be 'fun' to find. Jim McCullers WA4CWI Looks like we have an issue with memory usage in RAM If you load up CCS with the current project PacSatSW and build it then you can select VIEW -> Memory Allocation and look at the tab. You will see the package needs 154K or RAM and the Launpad has 191K. In the case of the TMS570LS0914 we have 128K max. You can expand RAM and the subfolders and see where the memory is being used. I worked for the last few days getting a HalCoGen setup for the LS0914 and then murging this HCG file with the code of the Launcpad project. After working through some issues it built but when it ran the linker it errored out with not enough memory. So faked it out and told the linker I had more memory. Then it would build and generate a .out file and the Memory Allocation info. It matches the launch pad build. Probably need to look for ways to reduce RAM needed. Reduce buffer sizes, move buffers to external memory, or take out code. I will be looking for things here to try and complete a basic build of the code for the LS0914. Please look for ideas and post any that you come up with. We probably should target RAM usage at about 80% of the max or about 100KB. We could change processors later but that would need some study. Bob [cid:[email protected]]

1 0

Re: Memory Problem on PacSatSW
by Bob Stricklin 16 Jan '24

16 Jan '24

OK will have a look at this. Found this note also which probably applies to us also: On MSP430 (or other) devices with limited RAM, the linker may fail to allocate the .bss or other sections allocated to RAM. The .bss section is for uninitialized global variables, and goes into RAM, along with stack (.stack) and heap (.sysmem) sections . If the code has a large number of global variables, you may run out of RAM space. If this is the case, you may consider making some of the variables const so they go into the .const section instead (which gets placed in FLASH instead of RAM). From: Burns Fisher (AMSAT) via pacsat-dev <pacsat-dev(a)amsat.org> Sent: Monday, January 15, 2024 6:38 PM To: Jim McCullers <wa4cwi(a)bellsouth.net> Cc: Pacsat Dev <pacsat-dev(a)amsat.org> Subject: [pacsat-dev] Re: Memory Problem on PacSatSW When you mentioned the heap, you reminded me: FreeRTOS has a heap, which is essentially just a big array. The only thing it gets used for is allocating task stacks and the structures that represent semaphores, queues, etc. And they way that I have used the OS, they get allocated but never released. But the thing I meant to say is that allocating smaller stacks does not use less memory from the linker's point of view because the array that the stacks are allocated from is not changed. There is a routine you can use to ask how much heap is free. After it is all booted up, unless the new code uses it differently than I did, any "free heap" is wasted. I think the size of the heap is an OS parameter in one of the free rtos header files. 73, Burns Fisher, WB1FJ AMSAT(R) Engineering -- Flight Software On Mon, Jan 15, 2024 at 7:31 PM Jim McCullers via pacsat-dev <pacsat-dev(a)amsat.org<mailto:[email protected]>> wrote: My version of CSS is either different or how did you turn on the green lines with summary data? I get a popup status message with similar info but not as stable or detailed as yours. On my system, I’m showing 80% utilization. The majority is in ucHeap (about 131k). I’ll bet on a function somewhere allocating a chunk of memory or repeatedly doing so and never using or releasing it. Should be ‘fun’ to find. Jim McCullers WA4CWI Looks like we have an issue with memory usage in RAM If you load up CCS with the current project PacSatSW and build it then you can select VIEW -> Memory Allocation and look at the tab. You will see the package needs 154K or RAM and the Launpad has 191K. In the case of the TMS570LS0914 we have 128K max. You can expand RAM and the subfolders and see where the memory is being used. I worked for the last few days getting a HalCoGen setup for the LS0914 and then murging this HCG file with the code of the Launcpad project. After working through some issues it built but when it ran the linker it errored out with not enough memory. So faked it out and told the linker I had more memory. Then it would build and generate a .out file and the Memory Allocation info. It matches the launch pad build. Probably need to look for ways to reduce RAM needed. Reduce buffer sizes, move buffers to external memory, or take out code. I will be looking for things here to try and complete a basic build of the code for the LS0914. Please look for ideas and post any that you come up with. We probably should target RAM usage at about 80% of the max or about 100KB. We could change processors later but that would need some study. Bob [cid:[email protected]] ----------------------------------------------------------- pacsat-dev mailing list -- pacsat-dev(a)amsat.org<mailto:[email protected]> View archives of this mailing list at https://mailman.amsat.org/hyperkitty/list/[email protected] To unsubscribe send an email to pacsat-dev-leave(a)amsat.org<mailto:[email protected]> Manage all of your AMSAT-NA mailing list preferences at https://mailman.amsat.org

1 0

Re: Memory Problem on PacSatSW
by Burns Fisher (AMSAT) 16 Jan '24

16 Jan '24

When you mentioned the heap, you reminded me: FreeRTOS has a heap, which is essentially just a big array. The only thing it gets used for is allocating task stacks and the structures that represent semaphores, queues, etc. And they way that I have used the OS, they get allocated but never released. But the thing I meant to say is that allocating smaller stacks does not use less memory from the linker's point of view because the array that the stacks are allocated from is not changed. There is a routine you can use to ask how much heap is free. After it is all booted up, unless the new code uses it differently than I did, any "free heap" is wasted. I think the size of the heap is an OS parameter in one of the free rtos header files. 73, Burns Fisher, WB1FJ *AMSAT(R) Engineering -- Flight Software* On Mon, Jan 15, 2024 at 7:31 PM Jim McCullers via pacsat-dev < pacsat-dev(a)amsat.org> wrote: > My version of CSS is either different or how did you turn on the green > lines with summary data? > > I get a popup status message with similar info but not as stable or > detailed as yours. > > > > On my system, I’m showing 80% utilization. > > The majority is in ucHeap (about 131k). > > I’ll bet on a function somewhere allocating a chunk of memory or > repeatedly doing so and never using or releasing it. > > Should be ‘fun’ to find. > > > > Jim McCullers > > WA4CWI > > > > > > > > Looks like we have an issue with memory usage in RAM > > > > If you load up CCS with the current project PacSatSW and build it then you > can select VIEW -> Memory Allocation and look at the tab. You will see the > package needs 154K or RAM and the Launpad has 191K. In the case of the > TMS570LS0914 we have 128K max. > > You can expand RAM and the subfolders and see where the memory is being > used. > > > > I worked for the last few days getting a HalCoGen setup for the LS0914 and > then murging this HCG file with the code of the Launcpad project. After > working through some issues it built but when it ran the linker it errored > out with not enough memory. So faked it out and told the linker I had more > memory. Then it would build and generate a .out file and the Memory > Allocation info. It matches the launch pad build. > > > > Probably need to look for ways to reduce RAM needed. Reduce buffer sizes, > move buffers to external memory, or take out code. > > > > I will be looking for things here to try and complete a basic build of the > code for the LS0914. Please look for ideas and post any that you come up > with. We probably should target RAM usage at about 80% of the max or about > 100KB. We could change processors later but that would need some study. > > > > Bob > > > > > ----------------------------------------------------------- > > pacsat-dev mailing list -- pacsat-dev(a)amsat.org > View archives of this mailing list at > https://mailman.amsat.org/hyperkitty/list/[email protected] > To unsubscribe send an email to pacsat-dev-leave(a)amsat.org > Manage all of your AMSAT-NA mailing list preferences at > https://mailman.amsat.org >

1 0

Re: Memory Problem on PacSatSW
by Jim McCullers 16 Jan '24

16 Jan '24

My version of CSS is either different or how did you turn on the green lines with summary data? I get a popup status message with similar info but not as stable or detailed as yours. On my system, I'm showing 80% utilization. The majority is in ucHeap (about 131k). I'll bet on a function somewhere allocating a chunk of memory or repeatedly doing so and never using or releasing it. Should be 'fun' to find. Jim McCullers WA4CWI Looks like we have an issue with memory usage in RAM If you load up CCS with the current project PacSatSW and build it then you can select VIEW -> Memory Allocation and look at the tab. You will see the package needs 154K or RAM and the Launpad has 191K. In the case of the TMS570LS0914 we have 128K max. You can expand RAM and the subfolders and see where the memory is being used. I worked for the last few days getting a HalCoGen setup for the LS0914 and then murging this HCG file with the code of the Launcpad project. After working through some issues it built but when it ran the linker it errored out with not enough memory. So faked it out and told the linker I had more memory. Then it would build and generate a .out file and the Memory Allocation info. It matches the launch pad build. Probably need to look for ways to reduce RAM needed. Reduce buffer sizes, move buffers to external memory, or take out code. I will be looking for things here to try and complete a basic build of the code for the LS0914. Please look for ideas and post any that you come up with. We probably should target RAM usage at about 80% of the max or about 100KB. We could change processors later but that would need some study. Bob

1 0

Re: Memory Problem on PacSatSW
by Burns Fisher (AMSAT) 15 Jan '24

15 Jan '24

Is there a variant of the TMS570LS0914 that has more memory? That might be the easiest fix. Note that what you call "external memory", really MRAM, is relatively slow. MRAM is also fairly small. It's big advantage is that it is non-volatile and fairly radiation resistant (and has a lot of space heritage with AMSAT and others). 73, Burns Fisher, WB1FJ *AMSAT(R) Engineering -- Flight Software* On Mon, Jan 15, 2024 at 4:16 PM Jim McCullers via pacsat-dev < pacsat-dev(a)amsat.org> wrote: > Since it ran and worked I never explored memory usage. > > I have to reconnect the development system and will cross check your > findings. > > That’s far more ram than I would have expected. > > > > Jim > > WA4CWI > > > > > > Looks like we have an issue with memory usage in RAM > > > > If you load up CCS with the current project PacSatSW and build it then you > can select VIEW -> Memory Allocation and look at the tab. You will see the > package needs 154K or RAM and the Launpad has 191K. In the case of the > TMS570LS0914 we have 128K max. > > You can expand RAM and the subfolders and see where the memory is being > used. > > > > I worked for the last few days getting a HalCoGen setup for the LS0914 and > then murging this HCG file with the code of the Launcpad project. After > working through some issues it built but when it ran the linker it errored > out with not enough memory. So faked it out and told the linker I had more > memory. Then it would build and generate a .out file and the Memory > Allocation info. It matches the launch pad build. > > > > Probably need to look for ways to reduce RAM needed. Reduce buffer sizes, > move buffers to external memory, or take out code. > > > > I will be looking for things here to try and complete a basic build of the > code for the LS0914. Please look for ideas and post any that you come up > with. We probably should target RAM usage at about 80% of the max or about > 100KB. We could change processors later but that would need some study. > > > > Bob > > > > > ----------------------------------------------------------- > > pacsat-dev mailing list -- pacsat-dev(a)amsat.org > View archives of this mailing list at > https://mailman.amsat.org/hyperkitty/list/[email protected] > To unsubscribe send an email to pacsat-dev-leave(a)amsat.org > Manage all of your AMSAT-NA mailing list preferences at > https://mailman.amsat.org >

1 0

Re: Memory Problem on PacSatSW
by Jim McCullers 15 Jan '24

15 Jan '24

Since it ran and worked I never explored memory usage. I have to reconnect the development system and will cross check your findings. That's far more ram than I would have expected. Jim WA4CWI Looks like we have an issue with memory usage in RAM If you load up CCS with the current project PacSatSW and build it then you can select VIEW -> Memory Allocation and look at the tab. You will see the package needs 154K or RAM and the Launpad has 191K. In the case of the TMS570LS0914 we have 128K max. You can expand RAM and the subfolders and see where the memory is being used. I worked for the last few days getting a HalCoGen setup for the LS0914 and then murging this HCG file with the code of the Launcpad project. After working through some issues it built but when it ran the linker it errored out with not enough memory. So faked it out and told the linker I had more memory. Then it would build and generate a .out file and the Memory Allocation info. It matches the launch pad build. Probably need to look for ways to reduce RAM needed. Reduce buffer sizes, move buffers to external memory, or take out code. I will be looking for things here to try and complete a basic build of the code for the LS0914. Please look for ideas and post any that you come up with. We probably should target RAM usage at about 80% of the max or about 100KB. We could change processors later but that would need some study. Bob

1 0