| andrewfr (~andrew@modemcable192.47-178-173.mc.videotron.ca) joined #pypy. | 00:32 | |
| bbot2 | 4Failure: 15http://buildbot.pypy.org/builders/own-macosx-x86-32/builds/759 | 00:32 |
|---|---|---|
| andrewfr (andrew@modemcable192.47-178-173.mc.videotron.ca) left #pypy. | 00:39 | |
| espes (espes@2001:470:1f05:ca1::) left irc: Ping timeout: 268 seconds | 00:49 | |
| bbot2 | 3Success: 15http://buildbot.pypy.org/builders/jit-benchmark-linux-x86-64-2/builds/15 | 00:54 |
| espes (~espes@123-243-221-248.tpgi.com.au) joined #pypy. | 00:58 | |
| bbot2 | 3Success: 15http://buildbot.pypy.org/builders/jit-benchmark-linux-x86-64/builds/187 | 00:59 |
| DasIch (~dasich@p4FFDCF99.dip.t-dialin.net) left irc: Remote host closed the connection | 01:09 | |
| DasIch (~dasich@p4FFDCF99.dip.t-dialin.net) joined #pypy. | 01:22 | |
| gutworth (~benjamin@64-131-9-52.usfamily.net) joined #pypy. | 01:26 | |
| DasIch (~dasich@p4FFDCF99.dip.t-dialin.net) left irc: Ping timeout: 252 seconds | 01:27 | |
| bbot2 | Started: 15http://buildbot.pypy.org/builders/own-linux-x86-32/builds/1904 | 01:30 |
| bbot2 | Started: 15http://buildbot.pypy.org/builders/pypy-c-jit-linux-x86-64/builds/656 | 01:30 |
| bbot2 | Started: 15http://buildbot.pypy.org/builders/pypy-c-jit-macosx-x86-64/builds/320 | 01:30 |
| bbot2 | Started: 15http://buildbot.pypy.org/builders/pypy-c-jit-win-x86-32/builds/310 | 01:30 |
| bbot2 | Started: 15http://buildbot.pypy.org/builders/pypy-c-app-level-linux-x86-64/builds/659 | 01:30 |
| bbot2 | Started: 15http://buildbot.pypy.org/builders/pypy-c-jit-linux-x86-32/builds/1175 | 01:30 |
| bbot2 | Started: 15http://buildbot.pypy.org/builders/pypy-c-Ojit-no-jit-linux-x86-32/builds/842 | 01:30 |
| bbot2 | Started: 15http://buildbot.pypy.org/builders/pypy-c-app-level-linux-x86-32/builds/1494 | 01:30 |
| bbot2 | Started: 15http://buildbot.pypy.org/builders/own-linux-x86-64/builds/769 | 01:30 |
| nettok_ (~quassel@200.119.174.210) joined #pypy. | 01:32 | |
| nettok (~quassel@200.119.177.100) left irc: Ping timeout: 255 seconds | 01:34 | |
| voidspace (~anonymous@python/psf/voidspace) left irc: Quit: voidspace | 01:53 | |
| espes (~espes@123-243-221-248.tpgi.com.au) left irc: Ping timeout: 252 seconds | 02:18 | |
| espes (~espes@123-243-221-248.tpgi.com.au) joined #pypy. | 02:27 | |
| bbot2 | 3Success: 15http://buildbot.pypy.org/builders/jit-benchmark-linux-x86-32/builds/996 | 02:39 |
| nedbat (~nedbat@python/psf/nedbat) left irc: Ping timeout: 255 seconds | 03:02 | |
| bbot2 | 4Failure: 15http://buildbot.pypy.org/builders/own-linux-x86-32/builds/1904 | 03:41 |
| thinker` (~thinker@218-167-101-86.dynamic.hinet.net) joined #pypy. | 03:46 | |
| hakanardo (~hakan@h59ec009e.seluldx.dyn.perspektivbredband.net) left irc: Read error: Operation timed out | 03:49 | |
| espes (~espes@123-243-221-248.tpgi.com.au) left irc: Ping timeout: 252 seconds | 04:03 | |
| tav_ (~tav@host-92-20-44-126.as13285.net) joined #pypy. | 04:07 | |
| espes (~espes@123-243-221-248.tpgi.com.au) joined #pypy. | 04:09 | |
| setmeaway (setmeaway@119.201.52.190) left irc: Read error: Connection reset by peer | 04:15 | |
| setmeaway (~setmeaway@119.201.52.190) joined #pypy. | 04:15 | |
| tilgovi (~randall@ool-4357ca60.dyn.optonline.net) joined #pypy. | 04:20 | |
| tilgovi (~randall@ool-4357ca60.dyn.optonline.net) left irc: Changing host | 04:20 | |
| tilgovi (~randall@couchdb/developer/tilgovi) joined #pypy. | 04:20 | |
| Sweet-P (~Sweet-P@203.205.116.93) joined #pypy. | 04:24 | |
| gutworth (~benjamin@64-131-9-52.usfamily.net) left irc: Ping timeout: 244 seconds | 04:32 | |
| bbot2 | 3Success: 15http://buildbot.pypy.org/builders/pypy-c-app-level-linux-x86-32/builds/1494 | 04:44 |
| bbot2 | 3Success: 15http://buildbot.pypy.org/builders/pypy-c-Ojit-no-jit-linux-x86-32/builds/842 | 04:44 |
| mimi_ (~mimi@97-88-28-179.dhcp.roch.mn.charter.com) joined #pypy. | 04:50 | |
| bbot2 | 3Success: 15http://buildbot.pypy.org/builders/pypy-c-app-level-linux-x86-64/builds/659 | 04:50 |
| gutworth (~benjamin@64-131-9-52.usfamily.net) joined #pypy. | 04:54 | |
| hakanardo (~hakan@h59ec009e.seluldx.dyn.perspektivbredband.net) joined #pypy. | 04:55 | |
| bbot2 | 3Success: 15http://buildbot.pypy.org/builders/pypy-c-jit-linux-x86-32/builds/1175 | 05:00 |
| tilgovi (~randall@couchdb/developer/tilgovi) left irc: Remote host closed the connection | 05:03 | |
| bbot2 | 3Success: 15http://buildbot.pypy.org/builders/pypy-c-jit-linux-x86-64/builds/656 | 05:13 |
| davisagli (davisagli@davisagli.com) left #pypy. | 05:14 | |
| anish_ (anish@nat/redhat/x-mytqdnhrphwenbqy) joined #pypy. | 05:34 | |
| gutworth (~benjamin@64-131-9-52.usfamily.net) left irc: Ping timeout: 248 seconds | 05:36 | |
| setmeaway (~setmeaway@119.201.52.190) left irc: Read error: Connection reset by peer | 05:45 | |
| setmeaway (setmeaway3@119.201.52.190) joined #pypy. | 05:45 | |
| setmeaway (setmeaway3@119.201.52.190) left irc: Read error: Connection reset by peer | 05:46 | |
| setmeaway (stemearay@119.201.52.190) joined #pypy. | 05:46 | |
| asmeurer (~asmeurer@c-174-56-21-245.hsd1.nm.comcast.net) left irc: Quit: asmeurer | 05:52 | |
| aleksi (~aleksi@176.57.74.133) joined #pypy. | 05:57 | |
| aleksi (~aleksi@176.57.74.133) left irc: Remote host closed the connection | 06:05 | |
| kenaan (~kenaan@cube.twistedmatrix.com) left irc: Ping timeout: 252 seconds | 06:10 | |
| bbot2 | 4Failure: 15http://buildbot.pypy.org/builders/own-linux-x86-64/builds/769 | 06:13 |
| unbit (~unbit@93-58-162-185.ip159.fastwebnet.it) left irc: Ping timeout: 252 seconds | 06:18 | |
| GDorn (gdorn@li223-147.members.linode.com) left #pypy. | 06:19 | |
| bbot2 | 4Failure: 15http://buildbot.pypy.org/builders/pypy-c-jit-macosx-x86-64/builds/320 | 06:23 |
| aleksi (~aleksi@85.235.191.82) joined #pypy. | 06:38 | |
| unbit (~unbit@93-58-162-185.ip159.fastwebnet.it) joined #pypy. | 07:06 | |
| bbot2 | 4Failure: 15http://buildbot.pypy.org/builders/pypy-c-jit-win-x86-32/builds/310 | 07:10 |
| fijal (~fijal@196-210-199-8.dynamic.isadsl.co.za) joined #pypy. | 07:43 | |
| JaRoel|4d (~jaroel|4d@office.fourdigits.nl) joined #pypy. | 07:44 | |
| hruske (~Gasper@188-230-156-183.dynamic.t-2.net) joined #pypy. | 07:50 | |
| hpk (~hpk@hq2.merlinux.eu) left irc: Read error: Operation timed out | 07:55 | |
| hpk (~hpk@hq2.merlinux.eu) joined #pypy. | 07:57 | |
| `fox` (~fox@host142-107-dynamic.45-79-r.retail.telecomitalia.it) joined #pypy. | 08:04 | |
| hpk (~hpk@hq2.merlinux.eu) got netsplit. | 08:15 | |
| unbit (~unbit@93-58-162-185.ip159.fastwebnet.it) got netsplit. | 08:15 | |
| stakkars (~tismer@p5DDB7A14.dip.t-dialin.net) got netsplit. | 08:15 | |
| Circlefusion (~cf@74-138-199-109.dhcp.insightbb.com) got netsplit. | 08:15 | |
| raydeo (~raydeo@merickel.org) got netsplit. | 08:15 | |
| zk (~is@whatit.is) got netsplit. | 08:15 | |
| hpk (~hpk@hq2.merlinux.eu) returned to #pypy. | 08:19 | |
| unbit (~unbit@93-58-162-185.ip159.fastwebnet.it) returned to #pypy. | 08:19 | |
| stakkars (~tismer@p5DDB7A14.dip.t-dialin.net) returned to #pypy. | 08:19 | |
| Circlefusion (~cf@74-138-199-109.dhcp.insightbb.com) returned to #pypy. | 08:19 | |
| raydeo (~raydeo@merickel.org) returned to #pypy. | 08:19 | |
| zk (~is@whatit.is) returned to #pypy. | 08:19 | |
| bivab (~david@ip-62-143-59-5.unitymediagroup.de) joined #pypy. | 08:20 | |
| bivab (david@ip-62-143-59-5.unitymediagroup.de) left #pypy. | 08:20 | |
| bivab (~david@ip-62-143-59-5.unitymediagroup.de) joined #pypy. | 08:21 | |
| antocuni (~antocuni@host117-71-dynamic.58-82-r.retail.telecomitalia.it) joined #pypy. | 08:23 | |
| zain (~textual@cpe-68-173-70-124.nyc.res.rr.com) left irc: Quit: Computer has gone to sleep. | 08:26 | |
| kenaan (~kenaan@cube.twistedmatrix.com) joined #pypy. | 08:27 | |
| kenaan | 12bivab arm-backend-2 11977efd55f3c6 15/pypy/jit/backend/arm/opassembler.py: (arigo, biab) make sure excetions are saved for call_assembler and call_may_force | 08:27 |
| kenaan | 12bivab arm-backend-2 1118234110368e 15/pypy/jit/backend/arm/: make the save_exc parameter non-optional | 08:27 |
| kenaan | 12bivab arm-backend-2 11aa7017a83625 15/pypy/jit/backend/arm/: fixes to emit_call and call_reaquire_gil | 08:27 |
| kenaan | 12bivab arm-backend-2 11bd95dd546f05 15/pypy/jit/backend/arm/: Cleanup | 08:27 |
| kenaan | 12bivab arm-backend-2 11c615cc3558ce 15/pypy/: merge default up to e4a0b9e4d23b | 08:27 |
| kenaan | 12bivab arm-backend-2 11c61c064e84b4 15/: merge default up to 3ff9c88dca39 | 08:27 |
| kenaan | 12bivab arm-backend-2 114a920a79a182 15/pypy/jit/backend/: update backend to new interface provided by compute_vars_longevity | 08:27 |
| kenaan | 12bivab arm-backend-2 11561c9d8112aa 15/: merge default up to 6fb87770b5d2 | 08:27 |
| kenaan | 12bivab arm-backend-2 1157c6036823fe 15/pypy/jit/backend/arm/: implement chages to the frame manager | 08:27 |
| kenaan | 12bivab arm-backend-2 11802e7c9df889 15/pypy/: merge 1a9a44331010 (jit-targets) | 08:27 |
| kenaan | 12bivab arm-backend-2 11d8831765a657 15/pypy/jit/backend/: move is_comparison_or_ovf_op to llsuport | 08:27 |
| kenaan | 12bivab arm-backend-2 113a1fca872e84 15/pypy/jit/backend/: implement changes needed for target/label functionality | 08:27 |
| zain (~textual@cpe-68-173-70-124.nyc.res.rr.com) joined #pypy. | 08:29 | |
| zain (~textual@cpe-68-173-70-124.nyc.res.rr.com) left irc: Client Quit | 08:32 | |
| zain (~textual@cpe-68-173-70-124.nyc.res.rr.com) joined #pypy. | 08:36 | |
| zain (~textual@cpe-68-173-70-124.nyc.res.rr.com) left irc: Client Quit | 08:36 | |
| thinker` (~thinker@218-167-101-86.dynamic.hinet.net) left irc: Remote host closed the connection | 08:46 | |
| fijal (~fijal@196-210-199-8.dynamic.isadsl.co.za) left irc: Ping timeout: 240 seconds | 08:54 | |
| EnCuKou (~encukou@ip-94-113-220-25.net.upcbroadband.cz) joined #pypy. | 09:03 | |
| espes (~espes@123-243-221-248.tpgi.com.au) left irc: Ping timeout: 276 seconds | 09:09 | |
| WildChild (~wildchild@modemcable123.12-202-24.mc.videotron.ca) left irc: Read error: Connection reset by peer | 09:13 | |
| WildChild (~wildchild@modemcable123.12-202-24.mc.videotron.ca) joined #pypy. | 09:13 | |
| espes (espes@2001:470:1f05:ca1::) joined #pypy. | 09:14 | |
| G2P (~G2P@fw-asn1.ornis.com) joined #pypy. | 09:20 | |
| nettok_ (~quassel@200.119.174.210) left irc: Remote host closed the connection | 09:41 | |
| verte-{nyctea} (~verte@python/site-packages/verte) joined #pypy. | 09:56 | |
| anish_ (anish@nat/redhat/x-mytqdnhrphwenbqy) left irc: Quit: Leaving | 10:24 | |
| thinker` (~Sinker@114-24-2-146.dynamic.hinet.net) joined #pypy. | 10:25 | |
| anish_ (anish@nat/redhat/x-iutkfagkrxygcmlk) joined #pypy. | 10:25 | |
| thinker` (~Sinker@114-24-2-146.dynamic.hinet.net) left irc: Remote host closed the connection | 10:26 | |
| Sinker (~thinker@114-24-2-146.dynamic.hinet.net) joined #pypy. | 10:28 | |
| anish_ (anish@nat/redhat/x-iutkfagkrxygcmlk) left irc: Ping timeout: 252 seconds | 10:30 | |
| voidspace (~anonymous@87-194-212-65.bethere.co.uk) joined #pypy. | 10:32 | |
| voidspace (~anonymous@87-194-212-65.bethere.co.uk) left irc: Changing host | 10:32 | |
| voidspace (~anonymous@python/psf/voidspace) joined #pypy. | 10:32 | |
| `fox` (~fox@host142-107-dynamic.45-79-r.retail.telecomitalia.it) left irc: Ping timeout: 244 seconds | 10:52 | |
| derdon (~derdon@pD9E1C99E.dip.t-dialin.net) joined #pypy. | 10:54 | |
| anish_ (anish@nat/redhat/x-erldvqbqewirxboc) joined #pypy. | 10:58 | |
| voidspace (~anonymous@python/psf/voidspace) left irc: Quit: voidspace | 11:01 | |
| mat^2 (mathias@87.55.0.198) joined #pypy. | 11:04 | |
| voidspace (~anonymous@python/psf/voidspace) joined #pypy. | 11:04 | |
| lizardo (~lizardo@189.2.128.130) joined #pypy. | 11:05 | |
| JaRoel|4d (~jaroel|4d@office.fourdigits.nl) left irc: Ping timeout: 268 seconds | 11:06 | |
| JaRoel|4d (~jaroel|4d@office.fourdigits.nl) joined #pypy. | 11:10 | |
| dracman (~draco@31-17-70-40-dynip.superkabel.de) left irc: Read error: Connection reset by peer | 11:13 | |
| kkris (~kris@93-82-44-248.adsl.highway.telekom.at) joined #pypy. | 11:20 | |
| tav_ (~tav@host-92-20-44-126.as13285.net) left irc: Ping timeout: 240 seconds | 11:23 | |
| azanella (~azanella@189.6.80.207) joined #pypy. | 11:25 | |
| Sinker (~thinker@114-24-2-146.dynamic.hinet.net) left irc: Ping timeout: 268 seconds | 11:27 | |
| tav_ (~tav@host-92-20-28-45.as13285.net) joined #pypy. | 11:30 | |
| nedbat (~nedbat@python/psf/nedbat) joined #pypy. | 11:37 | |
| Sinker (~thinker@114-45-177-184.dynamic.hinet.net) joined #pypy. | 11:39 | |
| `fox` (~fox@79.45.107.142) joined #pypy. | 11:47 | |
| anish_ (anish@nat/redhat/x-erldvqbqewirxboc) left irc: Quit: Leaving | 12:05 | |
| Sinker (~thinker@114-45-177-184.dynamic.hinet.net) left irc: Ping timeout: 252 seconds | 12:18 | |
| Nick change: verte-{nyctea} -> wleslie | 12:19 | |
| wleslie (~verte@python/site-packages/verte) left irc: Quit: ~~~ Crash in JIT! | 12:29 | |
| aleksi (~aleksi@85.235.191.82) left irc: Remote host closed the connection | 12:32 | |
| JaRoel (~jaroel|4d@office.fourdigits.nl) joined #pypy. | 12:35 | |
| JaRoel|4d (~jaroel|4d@office.fourdigits.nl) left irc: Ping timeout: 244 seconds | 12:39 | |
| `fox` (~fox@79.45.107.142) left irc: Ping timeout: 240 seconds | 12:39 | |
| `fox` (~fox@host142-107-dynamic.45-79-r.retail.telecomitalia.it) joined #pypy. | 12:43 | |
| steakknife (~steakknif@pfsense.hackerdojo.com) left irc: Quit: Leaving. | 12:52 | |
| DasIch (~dasich@p4FFDCF99.dip.t-dialin.net) joined #pypy. | 13:14 | |
| `fox` (~fox@host142-107-dynamic.45-79-r.retail.telecomitalia.it) left irc: Ping timeout: 252 seconds | 13:16 | |
| DasIch (~dasich@p4FFDCF99.dip.t-dialin.net) left irc: Ping timeout: 240 seconds | 13:18 | |
| `fox` (~fox@host142-107-dynamic.45-79-r.retail.telecomitalia.it) joined #pypy. | 13:20 | |
| mimi_ (~mimi@97-88-28-179.dhcp.roch.mn.charter.com) left irc: Ping timeout: 255 seconds | 13:33 | |
| Vorpal (~AnMaster@unaffiliated/anmaster) left irc: Ping timeout: 240 seconds | 13:35 | |
| anish_ (anish@nat/redhat/x-iyiaezjivoygbxdz) joined #pypy. | 13:36 | |
| nedbat (~nedbat@python/psf/nedbat) left irc: Ping timeout: 255 seconds | 13:38 | |
| Vorpal (~AnMaster@unaffiliated/anmaster) joined #pypy. | 13:43 | |
| Rhy0lite (dje@nat/ibm/x-vonrcckenjkanofl) joined #pypy. | 13:45 | |
| anish_ (anish@nat/redhat/x-iyiaezjivoygbxdz) left irc: Ping timeout: 252 seconds | 13:48 | |
| Rhy0lite | bivab: hi | 13:48 |
| bivab | Rhy0lite: hi | 13:48 |
| Rhy0lite | after our fix yesterday, I was able to fix a lot of the remaining PPC64 failures | 13:49 |
| Rhy0lite | there are a few strange ones, but mostly the skipped float tests | 13:49 |
| bivab | cool | 13:50 |
| bivab | so both backends are more or less at the same point again | 13:50 |
| bivab | or both versions of the backend | 13:50 |
| Rhy0lite | probably | 13:50 |
| Rhy0lite | I'm not sure about the exact state of the PPC32 backend | 13:51 |
| Rhy0lite | One strange failure is the memoryerror test | 13:51 |
| bivab | sven and armin were working on that test, but I do not recall how far they got with it | 13:52 |
| Rhy0lite | okay | 13:52 |
| Rhy0lite | I did not realize that failed on PPC32 as well | 13:53 |
| Rhy0lite | I don't know how the allocation can end up inconsistent | 13:53 |
| Rhy0lite | it's mainly that one and call_assembler | 13:54 |
| bivab | the idea for the memory error is to allocate something larger than the allocator can handle to trigger an error, is that what you mean? | 13:56 |
| Rhy0lite | maybe I'm confused about the test I mean | 13:59 |
| Rhy0lite | maybe it's test_free_loop_and_bridges | 13:59 |
| Rhy0lite | yes, that one | 14:00 |
| Rhy0lite | where total mallocs don't match | 14:00 |
| bivab | the function get_asmmemmgr_blocks is defined twice in ppc_assembler.py, maybe it is related to that issue | 14:06 |
| bivab | let me check | 14:06 |
| jnoller (~jnoller@vpn.nasuni.com) joined #pypy. | 14:08 | |
| Rhy0lite | ah! | 14:09 |
| Rhy0lite | hmm, and one seems wrong | 14:11 |
| Rhy0lite | no change from removing the one that sets clt.asmmemmrg = [] | 14:12 |
| bivab | hm, ok | 14:12 |
| iliya (~iliya@87-126-20-213.btc-net.bg) joined #pypy. | 14:26 | |
| lesshaste (~lesshaste@87-194-206-189.bethere.co.uk) joined #pypy. | 14:32 | |
| lahwran | this code really needs to be reviewed by a security pro | 14:44 |
| lahwran | would the pypy jit cause pypy to perform more slowly than cpython while the jit is doing it's thing? | 14:57 |
| lahwran | ie, for very short-lived python programs, would cpython be a better choice? | 14:57 |
| lahwran | or perhaps pypy without jit | 14:58 |
| lesshaste | lahwran: I don't know the answer but logically there must be some startup costs from pypy | 14:58 |
| lesshaste | lahwran: how short is short? | 14:58 |
| lahwran | 0.56 seconds on cpython, 0.74 seconds on pypy | 14:59 |
| lesshaste | out of interest.. if you run it only once you presumably don't care about the time difference | 14:59 |
| lahwran | no, it will be run very often | 15:00 |
| lesshaste | and if you run it many times, wouldn't it make sense to do that from within some other program? | 15:00 |
| lahwran | no | 15:00 |
| lahwran | well | 15:00 |
| lahwran | :/ I suppose it might | 15:00 |
| lahwran | the program is pypy_interact.py, the master component of the sandbox | 15:00 |
| lesshaste | lahwran: you can time the startup cost fairly easily | 15:01 |
| lahwran | oh? | 15:02 |
| lesshaste | lahwran: by writing a program that just prints "hello" to the screen for example | 15:02 |
| lesshaste | and timing it | 15:02 |
| lesshaste | well.. that will tell you something :) | 15:02 |
| lesshaste | maybe not everything | 15:02 |
| lahwran | the startup time of the jit will be longer for a larger program | 15:02 |
| lahwran | it shouldn't be significant, though; it's not a particularly large program, maybe a couple thousand lines on the longest path | 15:03 |
| lesshaste | lahwran: for detailed questions you may find the mailing list more helpful | 15:04 |
| lesshaste | I think the real gurus are all asleep now | 15:04 |
| lesshaste | or working :) | 15:04 |
| lahwran | hnnng I don't like mailing lists | 15:04 |
| lesshaste | then ask your question here with some pastbin'ed example and wait for 12 hours :) | 15:05 |
| fijal (~fijal@197.170.75.66) joined #pypy. | 15:05 | |
| lahwran | speak of the devil | 15:05 |
| lesshaste | lahwran: :) | 15:05 |
| lahwran | lesshaste: nah, I really need to sleep | 15:05 |
| lesshaste | lahwran: maybe they are waking up now :) | 15:05 |
| lahwran | and it's not significant, anyway; it turns out there's nothing wrong with running it on cpython | 15:06 |
| lahwran | looks like it was already using the pypy internal marshal.py | 15:06 |
| lesshaste | hi fijal | 15:06 |
| fijal | hi | 15:06 |
| fijal | what's up? | 15:06 |
| lesshaste | trying to work out how to make my code fast without rewriting it in C :) | 15:06 |
| lesshaste | how about you? | 15:06 |
| lesshaste | any ideas for things to help pypy make this faster? http://paste.pocoo.org/show/527346/ | 15:07 |
| lesshaste | I see there is to be a talk on this topic soon | 15:08 |
| lesshaste | from the blog | 15:08 |
| lesshaste | the bottleneck is hds = [hamdist(unknown, pattern[i:l+i]) for i in xrange(l)] which is called a lot.. I believe | 15:08 |
| fijal | what's hamdist? | 15:09 |
| fijal | and what's pattern? | 15:09 |
| fijal | lesshaste: you can look at traces | 15:09 |
| lesshaste | hamdist(str1, str2) just outputs the Hamming distance between two equal length strings | 15:09 |
| fijal | but I need to fix jitviewer to show code | 15:09 |
| lesshaste | that is the number of symbols that differ | 15:10 |
| lesshaste | a pattern is just a string of digits | 15:10 |
| fijal | one way to speed it up would be to pass the original string and indexes to hamdist | 15:10 |
| fijal | instead of a slice | 15:10 |
| fijal | I bet this is what you do in C | 15:10 |
| fijal | I can't say upfront if this is the case here | 15:10 |
| lesshaste | interesting.. thanks | 15:10 |
| fijal | JIT in general should be able to figure such stuff out | 15:15 |
| fijal | but not in this case | 15:15 |
| fijal | lesshaste: note that this is a potential optimization we *could* do, but we did not so far | 15:15 |
| lesshaste | fijal: cool | 15:15 |
| lesshaste | I heard some rumour of sse work too :) | 15:16 |
| lesshaste | which sounds like a good SoC project to me | 15:16 |
| fijal | for numpy only so far | 15:16 |
| lesshaste | made the change... 34 seconds to... 36 :) | 15:18 |
| lesshaste | oh | 15:18 |
| lesshaste | err | 15:18 |
| lesshaste | let me do that again | 15:19 |
| lesshaste | 34 seconds to ...29 | 15:19 |
| lesshaste | well that's something | 15:20 |
| lesshaste | you would have thought hamdist could be done amazingly quickly | 15:21 |
| kenaan | 12edelsohn ppc-jit-backend 118e95fc00f638 15/pypy/jit/backend/ppc/ppcgen/ppc_assembler.py: Remove duplicate, broken definition of get_asmmemmgr_blocks. Store TOC at correct offset for PPC64. | 15:21 |
| lesshaste | fijal: it's called 73 million times. I would have thought each call would be about < 100 instructions | 15:22 |
| fijal | lesshaste: you have to think how python operations are implemented | 15:22 |
| fijal | lesshaste: I'll look into that soon, but not right now | 15:22 |
| fijal | get back to me ok? | 15:22 |
| lesshaste | thanks! | 15:22 |
| lesshaste | let me paste the modified version | 15:22 |
| lesshaste | http://paste.pocoo.org/show/527356/ | 15:23 |
| lesshaste | I added comment line saying that if it's too fast on your computer, increase l to 6 | 15:24 |
| fijal | :] | 15:24 |
| lesshaste | my computer is slow so l=5 takes about 30 seconds :) | 15:24 |
| lesshaste | and 30 seconds is enough for me :) | 15:24 |
| fijal (~fijal@197.170.75.66) left irc: Read error: Connection reset by peer | 15:26 | |
| fijal (~fijal@197.172.62.161) joined #pypy. | 15:27 | |
| nedbat (~nedbat@python/psf/nedbat) joined #pypy. | 15:28 | |
| gutworth (~benjamin@64-131-9-52.usfamily.net) joined #pypy. | 15:34 | |
| bivab | Rhy0lite: found the reason for the failing test_free_loop_and_bridges test | 15:38 |
| Rhy0lite | great | 15:38 |
| bivab | the generated function descriptors are not allocated correctly | 15:38 |
| Rhy0lite | that makes sense as a point of leak | 15:39 |
| Kaskuka (~John@osbk-4db176e0.pool.mediaWays.net) left irc: Ping timeout: 240 seconds | 15:40 | |
| Kaskuka (~John@osbk-4d087292.pool.mediaWays.net) joined #pypy. | 15:40 | |
| bivab | yes, I will refactor the code a bit and add the fix | 15:41 |
| Rhy0lite | great. that means all support other than float is close to complete | 15:46 |
| lahwran | nedbat: I made a few changes to how --timeout works, uses select() and capping time.sleep now instead of a thread | 15:46 |
| lahwran | not sure how to contribute them, though | 15:47 |
| fijal | Rhy0lite: what's missing from complete completion? | 15:49 |
| Rhy0lite | fijal: test_assembler_call and test_cond_call_gc_wb_array_card_marking_fast_path | 15:51 |
| Rhy0lite | and test_memoryerror | 15:51 |
| fijal | you don't need gc_wb_fastpath | 15:53 |
| fijal | for stuff to work | 15:53 |
| fijal | as in you can try already translating if you fix test_call_assembler | 15:54 |
| fijal | at least small interpreters | 15:54 |
| fijal | is test_zll_random passing? | 15:54 |
| Rhy0lite | I haven't tried test_zll_random again | 15:54 |
| fijal | Rhy0lite: ok, this should pass before anything else | 15:56 |
| fijal | and will catch errors | 15:56 |
| Rhy0lite | yes | 15:56 |
| Rhy0lite | just celebrating the progress | 15:56 |
| kenaan | 12hager ppc-jit-backend 110c305ddabb69 15/pypy/jit/backend/ppc/ppcgen/ppc_assembler.py: (bivab) Fix allocation of function descriptors for PPC64 | 15:56 |
| fijal | ok :) | 15:57 |
| Rhy0lite | bivab: yea! | 15:57 |
| bivab | Rhy0lite: :) | 15:57 |
| mfoord (~anonymous@87-194-212-65.bethere.co.uk) joined #pypy. | 16:03 | |
| mfoord (~anonymous@87-194-212-65.bethere.co.uk) left irc: Changing host | 16:03 | |
| mfoord (~anonymous@python/psf/voidspace) joined #pypy. | 16:03 | |
| voidspace (~anonymous@python/psf/voidspace) left irc: Ping timeout: 252 seconds | 16:05 | |
| Nick change: mfoord -> voidspace | 16:05 | |
| mfoord (~anonymous@python/psf/voidspace) joined #pypy. | 16:06 | |
| lahwran | what does __pypy__.builtinify do? | 16:09 |
| fijal | lahwran: you know how C functions and python functions differ in CPython? | 16:09 |
| lahwran | no | 16:09 |
| voidspace (~anonymous@python/psf/voidspace) left irc: Ping timeout: 240 seconds | 16:09 | |
| fijal | if you attach a C-function to a class, it does not become a method | 16:10 |
| fijal | pypy functions have the same object whether they're in python or rpython | 16:10 |
| fijal | so we have a wrapper that makes them more builtin-like | 16:10 |
| fijal | obscure, isn't it? | 16:10 |
| mfoord (~anonymous@python/psf/voidspace) left irc: Ping timeout: 240 seconds | 16:10 | |
| lahwran | it just deletes __get__? | 16:10 |
| lahwran | is that really it? ._. | 16:11 |
| fijal | it's "enough" | 16:11 |
| lahwran | what is the purpose of doing that? | 16:11 |
| lahwran | _marshal seems to do it | 16:12 |
| fijal | because people complain | 16:12 |
| fijal | "but on CPython it behaves differently!" | 16:12 |
| fijal | the example is: | 16:13 |
| fijal | class A(object): | 16:13 |
| lahwran | excuse me, I'm just going to shove my hand through my face | 16:13 |
| fijal | close = os.close | 16:13 |
| fijal | now, can you run A.close()? | 16:13 |
| lahwran | I see | 16:13 |
| fijal | or A().close()? | 16:13 |
| fijal | depending how close is implemented (python vs C) you might or might not | 16:13 |
| voidspace (~anonymous@87-194-212-65.bethere.co.uk) joined #pypy. | 16:14 | |
| voidspace (~anonymous@87-194-212-65.bethere.co.uk) left irc: Changing host | 16:14 | |
| voidspace (~anonymous@python/psf/voidspace) joined #pypy. | 16:14 | |
| Alex_Gaynor | fijal: A should clearly subclass int :) | 16:14 |
| fijal | lahwran: generally "to fix it's easier than explain to tons of people" | 16:14 |
| fijal | Alex_Gaynor: hey | 16:14 |
| lahwran | seems like a bad thing to do anyway, but I can understand trying to be as compatible as possible with cpython | 16:14 |
| lahwran | I'm just trying to figure out _marshal | 16:15 |
| Action: Rhy0lite -> lunch | 16:15 | |
| lahwran | is _marshal normally run through rpython? | 16:16 |
| mat^2 (mathias@87.55.0.198) left irc: Ping timeout: 240 seconds | 16:16 | |
| nedbat (~nedbat@python/psf/nedbat) left irc: Ping timeout: 255 seconds | 16:18 | |
| davisagli (~davisagli@davisagli.com) joined #pypy. | 16:20 | |
| `fox` (~fox@host142-107-dynamic.45-79-r.retail.telecomitalia.it) left irc: Ping timeout: 252 seconds | 16:20 | |
| kenaan | 12fijal jitviewer 119e5303808452 15/: try slightly harder to display source, even in extraordinary conditions | 16:22 |
| fijal | yes | 16:22 |
| fijal | lahwran: so no wonder importing a version from lib_pypy takes longer | 16:22 |
| lahwran | eh? | 16:23 |
| fijal | Alex_Gaynor: jitviewer should work | 16:23 |
| fijal | lahwran: import marshal in pypy just imports a builtin moduel | 16:23 |
| fijal | Alex_Gaynor: at least pieces of it | 16:23 |
| fijal | lesshaste: ok, enough of jitviewer works for me to give a look | 16:23 |
| fijal | lesshaste: point 1 - we can't (yet) vectorize whatever you're doing | 16:23 |
| fijal | C can probably | 16:23 |
| fijal | lesshaste: 1. put stuff in a function, don't run it as globals | 16:28 |
| fijal | lesshaste: meh, there are definitely a few things that can be improved :/ | 16:31 |
| Alex_Gaynor | fijal: cool | 16:32 |
| fijal | lesshaste: I'm forced to go to a party, will look more later | 16:32 |
| Alex_Gaynor | fijal: CPython compiles very quickly you know | 16:32 |
| fijal | Alex_Gaynor: assembler and jumps don't quite work | 16:32 |
| fijal | the rest is fine | 16:32 |
| fijal | Alex_Gaynor: yeah, figured out | 16:32 |
| fijal | Alex_Gaynor: feel like adding it to speed.python buildbot? | 16:32 |
| Alex_Gaynor | not really | 16:33 |
| fijal | I think lesshaste found a pretty bad case for the jit | 16:34 |
| fijal (~fijal@197.172.62.161) left irc: Read error: Connection reset by peer | 16:35 | |
| iliya (~iliya@87-126-20-213.btc-net.bg) left irc: Quit: Ex-Chat | 16:37 | |
| lesshaste | thanks fijal | 16:39 |
| lesshaste | for when you get back :) | 16:39 |
| G2P (~G2P@fw-asn1.ornis.com) left irc: Quit: Leaving. | 16:44 | |
| witulski (~stupsi@ip-176-198-244-135.unitymediagroup.de) joined #pypy. | 16:46 | |
| JaRoel (~jaroel|4d@office.fourdigits.nl) left irc: Remote host closed the connection | 16:51 | |
| witulski (~stupsi@ip-176-198-244-135.unitymediagroup.de) left irc: Ping timeout: 252 seconds | 16:51 | |
| mat^2 (mathias@87.55.0.198) joined #pypy. | 16:58 | |
| JaRoel|4d (~jaroel|4d@office.fourdigits.nl) joined #pypy. | 17:02 | |
| JaRoel|4d (~jaroel|4d@office.fourdigits.nl) left irc: Remote host closed the connection | 17:06 | |
| kkris1 (~kris@93-82-45-133.adsl.highway.telekom.at) joined #pypy. | 17:11 | |
| kkris (~kris@93-82-44-248.adsl.highway.telekom.at) left irc: Ping timeout: 252 seconds | 17:12 | |
| Nick change: exarkun_ -> exarkun | 17:15 | |
| #pypy: mode change '+o exarkun' by ChanServ!ChanServ@services. | 17:15 | |
| nettok (~quassel@200.119.156.207) joined #pypy. | 17:18 | |
| nettok_ (~quassel@200.119.162.14) joined #pypy. | 17:31 | |
| nettok (~quassel@200.119.156.207) left irc: Ping timeout: 252 seconds | 17:33 | |
| asmeurer (~asmeurer@c-174-56-21-245.hsd1.nm.comcast.net) joined #pypy. | 17:35 | |
| derdon (~derdon@pD9E1C99E.dip.t-dialin.net) left irc: Remote host closed the connection | 17:38 | |
| voidspace (~anonymous@python/psf/voidspace) left irc: Quit: voidspace | 17:41 | |
| PiotrSikora (~none@nginx/adept/piotrsikora) left irc: Excess Flood | 17:45 | |
| PiotrSikora (~none@nginx/adept/piotrsikora) joined #pypy. | 17:47 | |
| antocuni (~antocuni@host117-71-dynamic.58-82-r.retail.telecomitalia.it) left irc: Ping timeout: 252 seconds | 17:56 | |
| nettok (~quassel@200.119.151.199) joined #pypy. | 17:57 | |
| nettok_ (~quassel@200.119.162.14) left irc: Ping timeout: 255 seconds | 17:59 | |
| jnoller (~jnoller@vpn.nasuni.com) left irc: Quit: Leaving... | 18:01 | |
| nedbat (~nedbat@python/psf/nedbat) joined #pypy. | 18:02 | |
| lmatos | Hi guys, I'm using pypy with venvs and setting --python=/usr/bin/pypy and --no-site-packages for my project is installing the packages in /opt/pypy/site-packages/. I've done some searching on pypy and venvs and the data looks to be a little dated. Any tips? | 18:07 |
| apollo13 (~apollo13@unaffiliated/apollo13) left irc: Ping timeout: 268 seconds | 18:09 | |
| ronny | lmatos: how are you running the installer? | 18:12 |
| lmatos | ronny: virtualenv --python=/usr/bin/pypy --no-sitepackages venvname | 18:13 |
| lmatos | I'm running Arch with this pypy build: http://www.archlinux.org/packages/community/i686/pypy/ | 18:14 |
| ronny | lmatos: and how do you run the installer for your package | 18:15 |
| MrGecko (~LizardWiz@219.161.66.86.rev.sfr.net) joined #pypy. | 18:16 | |
| MrGecko | Bonsoir :o) | 18:16 |
| lmatos | ronny: you mean the arch package? or my python code? The python code is django. To make sure we aren't circling the drain here let me give some more info. I've been trying to get gunicorn working this morning and it keeps telling me no module djang. I don't know where/why that failed so I was building a new env to test. That's when I noticed it wasn't installing in the venv's site-packages but rather /opy/pypy/. Does that help? | 18:18 |
| lmatos | django** | 18:18 |
| MostAwesomeDude | Does gunicorn work with PyPy? | 18:18 |
| Action: MostAwesomeDude checks | 18:18 | |
| ronny | lmatos: so how do you invoke the installer | 18:19 |
| MostAwesomeDude | Hm, yep, marked as working. | 18:19 |
| ronny | (of the python thing you want in the env) | 18:20 |
| lmatos | pip install thing but then it gave me permission denied to install in /opt/pypy/ so I then sudoed and realized wait, it shouldn't be installing there. | 18:22 |
| ronny | which pip did you invoke how | 18:23 |
| apollo13 (~apollo13@unaffiliated/apollo13) joined #pypy. | 18:26 | |
| lmatos | ronny: ah fsck. It looks like it was "global" pip. Not my venv's pip. | 18:27 |
| etrepum (~bob@75-101-96-144.dsl.static.sonic.net) left irc: Quit: etrepum | 18:28 | |
| MrGecko | Do you think I can yet improve the performance of my application trying to use array.array *naive*; I just read it is planned to be coming with pypy 1.8 but it looks like it is already shipped with 1.7 ? | 18:35 |
| nedbat (~nedbat@python/psf/nedbat) left irc: Ping timeout: 255 seconds | 18:35 | |
| lmatos | ronny: thanks for the lesson. xD | 18:36 |
| WildChild (~wildchild@modemcable123.12-202-24.mc.videotron.ca) got netsplit. | 18:38 | |
| Dulak (~michael@unaffiliated/dulak) got netsplit. | 18:38 | |
| WildChild (~wildchild@modemcable123.12-202-24.mc.videotron.ca) returned to #pypy. | 18:38 | |
| Dulak (~michael@unaffiliated/dulak) returned to #pypy. | 18:38 | |
| Rhy0lite (dje@nat/ibm/x-vonrcckenjkanofl) left irc: Quit: Leaving | 18:40 | |
| DanKluev (~root@109-109-211-093-xdsl.vntc.ru) left irc: Remote host closed the connection | 18:43 | |
| `fox` (~fox@host142-107-dynamic.45-79-r.retail.telecomitalia.it) joined #pypy. | 18:45 | |
| kalenz (~kalenz@ping.kalenz.fr) left irc: Ping timeout: 255 seconds | 18:51 | |
| EnCuKou (~encukou@ip-94-113-220-25.net.upcbroadband.cz) left irc: Ping timeout: 276 seconds | 18:54 | |
| DanKluev (~root@109-109-211-093-xdsl.vntc.ru) joined #pypy. | 18:55 | |
| kalenz (~kalenz@ping.kalenz.fr) joined #pypy. | 18:57 | |
| Nick change: kalenz -> Guest1514 | 18:57 | |
| `fox` (~fox@host142-107-dynamic.45-79-r.retail.telecomitalia.it) left irc: Ping timeout: 252 seconds | 18:59 | |
| EnCuKou (~encukou@ip-94-113-220-25.net.upcbroadband.cz) joined #pypy. | 19:09 | |
| nedbat (~nedbat@python/psf/nedbat) joined #pypy. | 19:26 | |
| nettok_ (~quassel@190.143.184.117) joined #pypy. | 19:36 | |
| nettok (~quassel@200.119.151.199) left irc: Ping timeout: 276 seconds | 19:39 | |
| fijal (~fijal@41.53.212.9) joined #pypy. | 19:45 | |
| bivab (~david@ip-62-143-59-5.unitymediagroup.de) left irc: Quit: bivab | 19:47 | |
| fijal | lesshaste: ping? | 20:00 |
| timotimo | MrGecko: what do you mean with naive? | 20:00 |
| MrGecko | i'm looking for magic tricks that will boost my perfs without much efforts :p | 20:01 |
| fijal | MrGecko: you can definitely try | 20:01 |
| fijal | array.array should be pretty fast | 20:01 |
| timotimo | well, access to arrays are already jitted if your loops are good for that kind of thing | 20:01 |
| fijal | depends on your usecase probably, but in general it should work | 20:01 |
| lesshaste | fijal: hi | 20:02 |
| timotimo | you can check with the jitviewer if the assembly instructions for your loops make sense | 20:02 |
| MrGecko | you know, when you're out of ideas to improve your algorithm, you're ready to try any command line and compilation options :p | 20:02 |
| timotimo | if they are particularly wasteful, you can probably talk to the people more involved with the jit here | 20:02 |
| fijal | lesshaste: so, when you pack stuff into function how much faster it is? | 20:02 |
| fijal | lesshaste: it is quite a bit for me | 20:02 |
| fijal | also, I fixed the random seed so it does not depend on the run | 20:02 |
| kenaan | 12boemmels lang-scheme 11b27460bc0d0d 15/scheme/test/test_scheme_level.py: Added a closure test | 20:02 |
| kenaan | 12boemmels lang-scheme 1162cfba56990c 15/scheme/: Implement "append" & "append!" | 20:02 |
| kenaan | 12boemmels lang-scheme 119eb92cb30772 15/scheme/: Move Parser helper-functions from object.py to ssparser.py | 20:02 |
| lesshaste | fijal: oh sorry I haven't done that.. well I did pass the index as you suggested not the slice | 20:03 |
| fijal | lesshaste: but in general, this is a pretty bad case for the JIT | 20:03 |
| lesshaste | fijal: what do you mean by pack stuff into a function in this case? | 20:03 |
| fijal | I can explain if you care :) | 20:03 |
| lesshaste | I do! | 20:03 |
| lesshaste | :) | 20:03 |
| fijal | lesshaste: don't run things in a global environment | 20:03 |
| fijal | but instead have everything in def main(): ... | 20:03 |
| lesshaste | oh I see | 20:03 |
| fijal | and if __name__ == '__main__': main() | 20:03 |
| lesshaste | you can tell what a python expert I am :) | 20:03 |
| fijal | it's a good idea either way :) | 20:03 |
| fijal | so calls to functions that contain loops that execute usually few instructions are worse than they should be | 20:04 |
| lesshaste | ah | 20:04 |
| fijal | it's definitely a "bug" | 20:04 |
| fijal | but a hard to fix one | 20:04 |
| lesshaste | in this case we are talking a small constant number of comparison | 20:04 |
| lesshaste | s | 20:04 |
| fijal | we can try playing with stuff | 20:04 |
| fijal | yes | 20:05 |
| lesshaste | is there a way to rewrite it to make pypy happier? | 20:05 |
| fijal | I found it's ~27% of time it exits | 20:05 |
| fijal | well, even if there is, I don't think it's a good idea | 20:05 |
| aleksi (~aleksi@176.57.74.133) joined #pypy. | 20:05 | |
| lesshaste | right | 20:05 |
| fijal | I think the JIT should figure out better | 20:05 |
| lesshaste | I didn't understand "I found it's ~27% of time it exits" | 20:05 |
| lesshaste | how much of a difference did using def main make? | 20:06 |
| fijal | I don't know, measure | 20:07 |
| fijal | also fix the seed | 20:07 |
| fijal | because it can be different between runs | 20:07 |
| lesshaste | hmm.. calls to functions that contain loops that execute usually few instructions.. this is where inlining would be used in C right? | 20:07 |
| fijal | no, pypy inlines | 20:07 |
| fijal | the crux is "contain loops" | 20:08 |
| lesshaste | oh | 20:08 |
| lesshaste | so what is the overhead? | 20:08 |
| lesshaste | ah | 20:08 |
| lesshaste | loop unrolling? | 20:08 |
| fijal | you don't inline because traces are linear | 20:08 |
| fijal | and because you don't inline, there is frame creation | 20:08 |
| fijal | (python frame creation) | 20:08 |
| fijal | packing and unpacking | 20:08 |
| fijal | pretty annoying stuff | 20:08 |
| lesshaste | ok .. I think I follow | 20:08 |
| lesshaste | so can you do some sort of loop unrolling? | 20:08 |
| Vorpal (~AnMaster@unaffiliated/anmaster) left irc: Read error: Connection reset by peer | 20:09 | |
| fijal | that's potentially dangerous | 20:09 |
| fijal | but we should improve the case where you don't do unrolling as well | 20:09 |
| fijal | lesshaste: anyway, I'll go to bed probably, this is something that's in my mind for a bit | 20:10 |
| fijal | but it's not directly "right now" | 20:10 |
| fijal | because it's hard and complex and requires experimentation | 20:10 |
| nickik (~nick@2001:67c:20a1:1018:226:9eff:feef:8369) joined #pypy. | 20:13 | |
| Vorpal (~AnMaster@unaffiliated/anmaster) joined #pypy. | 20:13 | |
| nickik (~nick@2001:67c:20a1:1018:226:9eff:feef:8369) left irc: Client Quit | 20:13 | |
| JaRoel|4d (~jaroel|4d@sink.jaroel.nl) joined #pypy. | 20:16 | |
| Vorpal (~AnMaster@unaffiliated/anmaster) left irc: Ping timeout: 240 seconds | 20:17 | |
| MrGecko | Ooh... nice Fatal RPython error: AssertionError :D | 20:19 |
| MrGecko | Did I win something ? | 20:19 |
| MrGecko | damn, I can't reproduce it again | 20:23 |
| jerith | Yup. An opportunity to debug. :-D | 20:23 |
| Vorpal (~AnMaster@unaffiliated/anmaster) joined #pypy. | 20:29 | |
| Vorpal (~AnMaster@unaffiliated/anmaster) left irc: Excess Flood | 20:30 | |
| fijal | MrGecko: there were quite a few fixed since 1.7 | 20:31 |
| fijal | MrGecko: also it should be reproducible | 20:32 |
| MrGecko | I use a nightly build I got a few days ago | 20:33 |
| MrGecko | I really don't know how to reproduce it, i'm sorry :) | 20:33 |
| fijal | heh | 20:34 |
| fijal | ok, so if you're using a nightly build, then try the release maybe :) | 20:34 |
| MrGecko | It only occured one time when I random.shuffle'd a list | 20:34 |
| Nick change: Guest1514 -> kalenz | 20:34 | |
| fijal | what we did was to merge quite a few experimental features | 20:34 |
| fijal | since the release | 20:34 |
| fijal | meh :/ | 20:34 |
| fijal | too bad you don't know the seed | 20:35 |
| fijal | MrGecko: anyway, any luck with speed? | 20:35 |
| MrGecko | Not yet.. But that's not a surprise, I didn't really expect any change. | 20:37 |
| fijal (~fijal@41.53.212.9) left irc: Ping timeout: 240 seconds | 20:41 | |
| lizardo (~lizardo@189.2.128.130) left irc: Ping timeout: 252 seconds | 20:42 | |
| aleksi (~aleksi@176.57.74.133) left irc: Remote host closed the connection | 20:48 | |
| lmatos | any psycopg2-ctypes users in here? | 21:04 |
| exarkun | I used pg8000 instead, it worked. | 21:05 |
| lmatos | exarkun: does that play nice with django? I'm not sure :/ | 21:06 |
| lmatos | exarkun: was the speed acceptable? | 21:06 |
| jerith | lmatos: I used it to test that my stuff works on pypy. | 21:07 |
| jerith | It doesn't play nice with Django for the same reasons psycopg2 1.4.2+ doesn't. | 21:08 |
| mvt (~mvantelli@53530442.cm-6-4a.dynamic.ziggo.nl) joined #pypy. | 21:08 | |
| jerith | (psycopg2ct, that is.) | 21:08 |
| lmatos | jerith: can you elaborate or provide links to such info? I'm not sure why psycopg2 1.4.2 doesn't play nice with django :/ | 21:09 |
| jerith | Er, 2.4.2 | 21:09 |
| jerith | https://code.djangoproject.com/ticket/16250 | 21:10 |
| mvt | they should have included it in 1.3.1 ... | 21:11 |
| mvt | anyway afaik only the testrunner is affected | 21:12 |
| jerith | Yeah. | 21:12 |
| jerith | But still, it's nice to be able to run tests for your code. | 21:12 |
| fijal (~fijal@197.109.111.224) joined #pypy. | 21:23 | |
| Count_Niedar (~nnscript@ip68-231-248-182.hr.hr.cox.net) joined #pypy. | 21:28 | |
| Niedar (~nnscript@ip68-231-248-182.hr.hr.cox.net) left irc: Ping timeout: 240 seconds | 21:31 | |
| fijal | Alex_Gaynor: ping | 21:32 |
| lmatos | exarkun: was the speed acceptable? | 21:34 |
| lmatos | exarkun: ^ ignore this. lag issue. | 21:35 |
| lmatos | jerith: I mean it's running it's just looking slow so I'm not sure if it's pyscopg2ct or something else. I'm going to do some profiling to see but I suspect it's pyscopg2ct as it seems like it would be the "weakest link" | 21:36 |
| mvt | lmatos: really psycopg2ct should not be that much slower then psycopg2 (i don't think the overhead is that big for 40 a 50 queries) | 21:36 |
| jerith | lmatos: The Django ORM is made out of slow. | 21:37 |
| mvt | but you should really run django under pypy for a while before it get's faster | 21:37 |
| lmatos | jerith: true. | 21:37 |
| Alex_Gaynor | fijal: pong | 21:38 |
| lmatos | IF you guys wanna help the stack is running here: www.gencyclothing.com and you'll see what I mean. (No CSS ATM as I need to adjust some paths) What's the best way as to begin profiling this? | 21:39 |
| fijal | Alex_Gaynor: if you really care about the hash attack, cuckoo hashing is to be considered | 21:39 |
| mvt | lmatos: Try to run it with cpython 2.7 + psycopg2ct as a test | 21:39 |
| mvt | if that is also really slow, then psycopg2ct is the bottleneck | 21:40 |
| Alex_Gaynor | fijal: I think shipping a Tree based map or such is better | 21:40 |
| lmatos | mvt: I'm going to try that now with a test stack. | 21:40 |
| fijal | Alex_Gaynor: that's cpython's job, isn't it | 21:41 |
| fijal | "only in 3.8" | 21:41 |
| gutworth | trees are so slow | 21:42 |
| exarkun | especially hard wood | 21:42 |
| gutworth | although less slow than a dosed dict :) | 21:43 |
| voidspace (~anonymous@87-194-212-65.bethere.co.uk) joined #pypy. | 21:44 | |
| voidspace (~anonymous@87-194-212-65.bethere.co.uk) left irc: Changing host | 21:44 | |
| voidspace (~anonymous@python/psf/voidspace) joined #pypy. | 21:44 | |
| fijal | lmatos: cprofile would be a good start | 21:45 |
| lmatos | fijal: I'm going to give that a look as soon as I test this stack. 30% there. :) | 21:48 |
| lmatos | thanks! | 21:48 |
| chee1 (~chee1@fw2.wink.com) joined #pypy. | 21:49 | |
| kkris1 (~kris@93-82-45-133.adsl.highway.telekom.at) left irc: Quit: Leaving. | 21:58 | |
| CIA-53 | 03cheecheeo 07roundup * 10#974/channel is not iterable: | 22:02 |
| CIA-53 | [new] pypy's channels are not iterable although the stackless documentation states | 22:02 |
| CIA-53 | that they are: | 22:02 |
| CIA-53 | http://www.disinterest.org/resource/stackless/ ... * 14https://bugs.pypy.org/issue974 | 22:02 |
| voidspace (~anonymous@python/psf/voidspace) left irc: Quit: voidspace | 22:03 | |
| fijal (~fijal@197.109.111.224) left irc: Read error: Connection reset by peer | 22:18 | |
| bbot2 | Started: 15http://buildbot.pypy.org/builders/own-macosx-x86-32/builds/760 | 22:30 |
| bbot2 | Started: 15http://buildbot.pypy.org/builders/jit-benchmark-linux-x86-64/builds/188 | 22:30 |
| bbot2 | Started: 15http://buildbot.pypy.org/builders/jit-benchmark-linux-x86-32/builds/997 | 22:30 |
| bbot2 | Started: 15http://buildbot.pypy.org/builders/jit-benchmark-linux-x86-64-2/builds/16 | 22:30 |
| azanella (~azanella@189.6.80.207) left irc: Ping timeout: 244 seconds | 22:41 | |
| voidspace (~anonymous@87-194-212-65.bethere.co.uk) joined #pypy. | 22:52 | |
| voidspace (~anonymous@87-194-212-65.bethere.co.uk) left irc: Changing host | 22:52 | |
| voidspace (~anonymous@python/psf/voidspace) joined #pypy. | 22:52 | |
| mvt | lmatos, just did some testing regarding psycopg2ct, but it really is faster then psycopg2 if you let the JIT do it's thing | 22:54 |
| lmatos | mvt: "let the JIT do it's thing" implies that I don't need to do anything special to get it to do it? What needs to happen to get that JIT doing thangs? | 22:55 |
| mvt | rendering a page with 1600 rows with a semi-complex orm query is for example ~30-40% faster running with pypy + psycopg2ct then cpython + psycopg2 | 22:55 |
| mvt | well for every request it should get faster | 22:56 |
| mvt | I'm not an expert, but i thought that a loop needed to be iterated 1000 times before it gets fast | 22:57 |
| lmatos | Alex_Gaynor: ^ can you confirm this? | 22:58 |
| Alex_Gaynor | 1039 iterations of a loop, yes | 22:59 |
| Alex_Gaynor | you can lower it if you want, but that can have mixed effects | 22:59 |
| lmatos | thanks! No need to lower, just more testing. | 22:59 |
| lmatos | mvt: I appreciate it! I was working on my testing setup and my vm got wiped. :( I'm going to try cprofile now to see what I can learn. :D | 23:00 |
| lmatos | I've never profiled before and I'm trying to get an idea of the best way to profile django. Any tips? | 23:02 |
| mvt | the django-command-extensions has a runprofileserver, the you simply run "python manage.py runprofileserver --kcachegrind --prof-path=profiles" | 23:05 |
| mvt | and open the profile with kcachegrind | 23:05 |
| mvt | or runsnakerun | 23:06 |
| mvt (~mvantelli@53530442.cm-6-4a.dynamic.ziggo.nl) left irc: Quit: Leaving | 23:10 | |
| chee1 (chee1@fw2.wink.com) left #pypy. | 23:12 | |
| fschwidom (~fschwidom@2.208.38.85) joined #pypy. | 23:28 | |
| nedbat (~nedbat@python/psf/nedbat) left irc: Ping timeout: 276 seconds | 23:31 | |
| fschwidom (~fschwidom@2.208.38.85) left irc: Remote host closed the connection | 23:33 | |
| nedbat (~nedbat@python/psf/nedbat) joined #pypy. | 23:34 | |
| MrGecko (~LizardWiz@219.161.66.86.rev.sfr.net) left irc: Remote host closed the connection | 23:39 | |
| Arfrever (~Arfrever@apache/committer/Arfrever) left irc: Read error: Operation timed out | 23:45 | |
| nedbat (~nedbat@python/psf/nedbat) left irc: Ping timeout: 255 seconds | 23:57 | |
| --- Fri Dec 30 2011 | 00:00 | |
Generated by irclog2html.py 2.9.2 by Marius Gedminas - find it at mg.pov.lt!