[genivi-dlt] [PATCH] Multithreaded DLT file parser

Lassi Marttala lassi.marttala at gmail.com
Wed Mar 9 08:34:17 EST 2016


Couple of years ago, I implemented memory mapped I/O for file parsing. The
current implementation is somewhat nerfed version, because of limitations
in windows implementation of mmap, especially on 32 bit machines.

Threading was also tried, but at that time the bottleneck turned out to be
I/O, and multithreading made the indexing slower.

You can get really impressive improvements on 64bit Linux, by modifying the
file reading to use single continuous memory map instead of the current
segmenting it is doing.

I can look up details later when I'm at my computer.
9.3.2016 12.06 "Helwing, Lutz" <Lutz_Helwing at mentor.com> kirjoitti:

> Dear DLT community,
>
> the patch has been integrated into master. Please excuse the merge commit,
> i didn't know that there have been new commits.
>
> At this occasion i like to inform you that the DLT project will be
> continued directly by BMW.
> Gernot Wirschal <Gernot.Wirschal at bmw.de> <Gernot.Wirschal at bmw.de> will be
> the responsible contact for DLT maintenance tasks.
>
> I'd like to say goodbye and thank you all for your great contributions and
> wish you success with using and improving DLT in future!
>
> Kind regards
> Lutz
>
> On 02/03/16 10:57, Helwing, Lutz wrote:
>
> Hi all,
>
> we'd like to propose a patch which speeds up parsing of DLT files.
>
> The functions DltFileIndexer::indexFilter() and
> DltFileIndexer::indexDefaultFilter() will use a helper thread if filters
> and/or plugins are active to speed up DLT file loading.
>
> Please see the attached Excel sheet for some numbers indicating the speed
> up.
>
> As long as any filters or plugins are used, a time improvement is achieved
> by using an extra helper thread. Therefore, threading is only useful if at
> least one filter or plugin is active.
>
> If no objections arise the patch will be integrated into master within 5
> working days.
>
> Cheers
> Lutz
>
> --
>
> *Lutz Helwing*
> Senior Engineer
>
> Telefon
>
> +49 (89) 57096 - 297 <+49%287721%294060-422>
>
> Fax
>
> +49 (89) 57096 - 400
>
> <Oliver_Hartfuss at mentor.com> <lutz_helwing at mentor.com>
> lutz_helwing at mentor.com
>
>
> *[image: Mentor Automotive] Mentor Graphics Development (Deutschland) GmbH*
> Arnulfstrasse 201
> D-80634 München
> <http://www.mentor.com> <http://www.mentor.com>http://www.mentor.com
> <http://www.mentor.com>
>
> Mentor Graphics Development (Deutschland) GmbH
> Geschäftsführung: Dean Freed, Walter Vermijs, Shannon Wetzel
> Handelsregister: Amtsgericht Freiburg i.Br., HRB 705237
> Sitz der Gesellschaft: Peterzeller Straße 8, 78048 Villingen-Schwenningen
> USt-Id Nummer: DE268786819
>
> Confidentiality Notice: This e-mail message, including any attachments, is
> for the sole use of the intended recipient(s) and may contain confidential
> and privileged information. Any unauthorized review, use, disclosure or
> distribution is prohibited. If you are not the intended recipient, please
> contact the sender by return e-mail and destroy all copies of the original
> message.
>
>
>
>
> _______________________________________________
> genivi-diagnostic-log-and-trace mailing listgenivi-diagnostic-log-and-trace at lists.genivi.orghttps://lists.genivi.org/mailman/listinfo/genivi-diagnostic-log-and-trace
>
>
>
> _______________________________________________
> genivi-diagnostic-log-and-trace mailing list
> genivi-diagnostic-log-and-trace at lists.genivi.org
> https://lists.genivi.org/mailman/listinfo/genivi-diagnostic-log-and-trace
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.genivi.org/pipermail/genivi-diagnostic-log-and-trace_lists.genivi.org/attachments/20160309/a8b88f19/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: ATT00001.png
Type: image/png
Size: 7787 bytes
Desc: not available
URL: <http://lists.genivi.org/pipermail/genivi-diagnostic-log-and-trace_lists.genivi.org/attachments/20160309/a8b88f19/attachment.png>


More information about the genivi-diagnostic-log-and-trace mailing list