| mwhudson_ (~mwh@121-73-77-183.cable.telstraclear.net) left irc: Ping timeout: 245 seconds | 00:04 | |
| nedbat (nedbat@python/psf/nedbat) joined #pypy. | 00:07 | |
| Tobu (~Tobu@unaffiliated/tobu) left irc: Ping timeout: 252 seconds | 00:17 | |
| Tobu (~Tobu@unaffiliated/tobu) joined #pypy. | 00:17 | |
| Rhyolite | fijal: are you still awake? | 00:23 |
|---|---|---|
| fijal | sorta | 00:24 |
| fijal | why? | 00:24 |
| buribu (~buribu@177.41.209.170) joined #pypy. | 00:33 | |
| buribu (~buribu@177.41.209.170) left irc: Changing host | 00:33 | |
| buribu (~buribu@unaffiliated/buribu) joined #pypy. | 00:33 | |
| bbot2 | 4Failure: 15http://buildbot.pypy.org/builders/own-macosx-x86-32/builds/789 | 01:03 |
| rekamso (~textual@216.190.27.14) left irc: Ping timeout: 276 seconds | 01:03 | |
| EnCuKou (~encukou@ip-94-113-220-25.net.upcbroadband.cz) joined #pypy. | 01:08 | |
| Tobu (~Tobu@unaffiliated/tobu) left irc: Ping timeout: 252 seconds | 01:09 | |
| bbot2 | 4Failure: 15http://buildbot.pypy.org/builders/jit-benchmark-linux-x86-32/builds/1037 [12fijal] | 01:09 |
| tilgovi (~randall@couchdb/developer/tilgovi) joined #pypy. | 01:12 | |
| tilgovi (~randall@couchdb/developer/tilgovi) left irc: Read error: Connection reset by peer | 01:20 | |
| ericflo (~ericflo@75.103.8.110) left irc: Quit: ericflo | 01:23 | |
| nettok (~quassel@190.148.27.106) joined #pypy. | 01:33 | |
| bbot2 | 3Success: 15http://buildbot.pypy.org/builders/jit-benchmark-linux-x86-64-2/builds/48 [12fijal] | 01:46 |
| whitelynx (~whitelynx@75.111.197.204) joined #pypy. | 01:55 | |
| nedbat (nedbat@python/psf/nedbat) left irc: Ping timeout: 255 seconds | 01:57 | |
| bbot2 | Started: 15http://buildbot.pypy.org/builders/pypy-c-jit-linux-x86-64/builds/692 | 02:00 |
| bbot2 | Started: 15http://buildbot.pypy.org/builders/own-linux-x86-64/builds/803 | 02:00 |
| bbot2 | Started: 15http://buildbot.pypy.org/builders/pypy-c-Ojit-no-jit-linux-x86-32/builds/874 | 02:00 |
| bbot2 | Started: 15http://buildbot.pypy.org/builders/pypy-c-jit-linux-x86-32/builds/1214 | 02:00 |
| bbot2 | Started: 15http://buildbot.pypy.org/builders/pypy-c-app-level-linux-x86-64/builds/689 | 02:00 |
| bbot2 | Started: 15http://buildbot.pypy.org/builders/pypy-c-app-level-linux-x86-32/builds/1533 | 02:00 |
| bbot2 | Started: 15http://buildbot.pypy.org/builders/pypy-c-jit-win-x86-32/builds/342 | 02:00 |
| bbot2 | Started: 15http://buildbot.pypy.org/builders/pypy-c-jit-macosx-x86-64/builds/352 | 02:00 |
| bbot2 | Started: 15http://buildbot.pypy.org/builders/own-linux-x86-32/builds/1944 | 02:00 |
| davisagli (~davisagli@davisagli.com) left irc: Excess Flood | 02:06 | |
| davisagli (~davisagli@davisagli.com) joined #pypy. | 02:07 | |
| Tobu (~Tobu@unaffiliated/tobu) joined #pypy. | 02:12 | |
| nedbat (~nedbat@python/psf/nedbat) joined #pypy. | 02:13 | |
| ixokai (~ixokai@rrcs-24-199-8-246.west.biz.rr.com) joined #pypy. | 02:32 | |
| ixokai (~ixokai@rrcs-24-199-8-246.west.biz.rr.com) left irc: Changing host | 02:32 | |
| ixokai (~ixokai@pdpc/supporter/student/ixokai) joined #pypy. | 02:32 | |
| Tobu (~Tobu@unaffiliated/tobu) left irc: Ping timeout: 272 seconds | 02:45 | |
| Tobu (~Tobu@unaffiliated/tobu) joined #pypy. | 02:53 | |
| bbot2 | 3Success: 15http://buildbot.pypy.org/builders/jit-benchmark-linux-x86-64/builds/220 [12fijal] | 02:53 |
| Shanita (~John@osbk-4db1576f.pool.mediaWays.net) joined #pypy. | 03:04 | |
| Kaskuka (~John@osbk-4db06c7e.pool.mediaWays.net) left irc: Ping timeout: 276 seconds | 03:04 | |
| berdario (~Tiibiidii@host142-83-dynamic.2-87-r.retail.telecomitalia.it) left irc: Ping timeout: 276 seconds | 03:23 | |
| bbot2 | 4Failure: 15http://buildbot.pypy.org/builders/pypy-c-jit-win-x86-32/builds/342 | 03:27 |
| take_cheeze (~Adium@pc06224.anc-tv.ne.jp) joined #pypy. | 03:55 | |
| bbot2 | 4Failure: 15http://buildbot.pypy.org/builders/pypy-c-jit-linux-x86-64/builds/692 | 03:57 |
| take_cheeze (~Adium@pc06224.anc-tv.ne.jp) left irc: Quit: Leaving. | 03:59 | |
| ixokai_ (~ixokai@rrcs-24-199-8-246.west.biz.rr.com) joined #pypy. | 04:03 | |
| ixokai_ (~ixokai@rrcs-24-199-8-246.west.biz.rr.com) left irc: Changing host | 04:03 | |
| ixokai_ (~ixokai@pdpc/supporter/student/ixokai) joined #pypy. | 04:03 | |
| ixokai_ (~ixokai@pdpc/supporter/student/ixokai) left irc: Read error: Connection reset by peer | 04:04 | |
| ixokai__ (~ixokai@rrcs-24-199-8-246.west.biz.rr.com) joined #pypy. | 04:04 | |
| ixokai__ (~ixokai@rrcs-24-199-8-246.west.biz.rr.com) left irc: Changing host | 04:04 | |
| ixokai__ (~ixokai@pdpc/supporter/student/ixokai) joined #pypy. | 04:04 | |
| take_cheeze (~Adium@pc06224.anc-tv.ne.jp) joined #pypy. | 04:06 | |
| ixokai (~ixokai@pdpc/supporter/student/ixokai) left irc: Ping timeout: 248 seconds | 04:07 | |
| nedbat (~nedbat@python/psf/nedbat) left irc: Ping timeout: 276 seconds | 04:09 | |
| aboudreault__ (~alanb@modemcable072.19-23-96.mc.videotron.ca) joined #pypy. | 04:18 | |
| Nick change: ixokai__ -> ixokai | 04:38 | |
| bbot2 | 4Failure: 15http://buildbot.pypy.org/builders/own-linux-x86-64/builds/803 | 04:57 |
| whyking (~quassel@ip68-14-13-208.ri.ri.cox.net) joined #pypy. | 05:06 | |
| DasIch_ (~DasIch@p3E991232.dip.t-dialin.net) joined #pypy. | 05:09 | |
| DasIch (~DasIch@p3E9901EF.dip.t-dialin.net) left irc: Read error: Operation timed out | 05:10 | |
| Nick change: DasIch_ -> DasIch | 05:10 | |
| Nick change: aboudreault__ -> aboudreault | 05:11 | |
| aboudreault (~alanb@modemcable072.19-23-96.mc.videotron.ca) left irc: Changing host | 05:11 | |
| aboudreault (~alanb@osgeo/member/aboudreault) joined #pypy. | 05:11 | |
| ixokai (~ixokai@pdpc/supporter/student/ixokai) left irc: Quit: Bye! | 05:17 | |
| whyking (~quassel@ip68-14-13-208.ri.ri.cox.net) left irc: Ping timeout: 260 seconds | 05:19 | |
| nettok (~quassel@190.148.27.106) left irc: Ping timeout: 252 seconds | 05:21 | |
| buribu (~buribu@unaffiliated/buribu) left irc: Remote host closed the connection | 05:32 | |
| Tobu (~Tobu@unaffiliated/tobu) left irc: Ping timeout: 248 seconds | 05:35 | |
| bbot2 | 4Failure: 15http://buildbot.pypy.org/builders/pypy-c-app-level-linux-x86-32/builds/1533 | 05:56 |
| bbot2 | 4Failure: 15http://buildbot.pypy.org/builders/pypy-c-Ojit-no-jit-linux-x86-32/builds/874 | 05:56 |
| bbot2 | 4Failure: 15http://buildbot.pypy.org/builders/pypy-c-app-level-linux-x86-64/builds/689 | 05:58 |
| bbot2 | 4Failure: 15http://buildbot.pypy.org/builders/pypy-c-jit-linux-x86-32/builds/1214 | 06:09 |
| mrsipan_ (~ben@ip98-163-95-196.dc.dc.cox.net) joined #pypy. | 06:16 | |
| intchanter (~intchante@c-76-27-100-38.hsd1.ut.comcast.net) left irc: Read error: Operation timed out | 06:18 | |
| intchanter (~intchante@c-76-27-100-38.hsd1.ut.comcast.net) joined #pypy. | 06:21 | |
| Tobu (~Tobu@unaffiliated/tobu) joined #pypy. | 06:37 | |
| bbot2 | 4Failure: 15http://buildbot.pypy.org/builders/pypy-c-jit-macosx-x86-64/builds/352 | 06:40 |
| whitelynx (~whitelynx@75.111.197.204) left irc: Quit: Ex-Chat | 06:42 | |
| ronan__ (~ronan@host86-172-62-103.range86-172.btcentralplus.com) joined #pypy. | 06:48 | |
| ronan (~ronan@host86-172-60-8.range86-172.btcentralplus.com) left irc: Ping timeout: 245 seconds | 06:50 | |
| mikefc (~mike@60-242-240-196.static.tpgi.com.au) left irc: Quit: mikefc | 06:51 | |
| Garen_ (garen@69.76.18.3) joined #pypy. | 06:56 | |
| asmeurer (~asmeurer@dhcp-altamirano-166.resnet.nmt.edu) left irc: Quit: asmeurer | 07:10 | |
| bbot2 | 3Success: 15http://buildbot.pypy.org/builders/own-linux-x86-32/builds/1944 | 07:11 |
| bbot2 | Started: 15http://buildbot.pypy.org/builders/own-linux-x86-32/builds/1945 [py3k] | 07:11 |
| aboudreault (~alanb@osgeo/member/aboudreault) left irc: Quit: Leaving | 07:16 | |
| alexsuraci_ (u1962@gateway/web/irccloud.com/x-uzwnigekobqfddho) joined #pypy. | 07:36 | |
| AlekSi (~AlekSi@176.57.74.133) joined #pypy. | 07:37 | |
| vad (~vad@95.233.48.120) joined #pypy. | 07:53 | |
| amaury_ (~amaury_@46-127-23-192.dynamic.hispeed.ch) joined #pypy. | 08:03 | |
| vad (~vad@95.233.48.120) left irc: Remote host closed the connection | 08:06 | |
| zain (~textual@46.120.28.30) joined #pypy. | 08:13 | |
| bbot2 | 4Failure: 15http://buildbot.pypy.org/builders/own-linux-x86-32/builds/1945 [py3k] | 08:15 |
| AlekSi (~AlekSi@176.57.74.133) left irc: Remote host closed the connection | 08:21 | |
| dmitrey (~quassel@77.121.195.200) joined #pypy. | 08:28 | |
| dmitrey (~quassel@77.121.195.200) left irc: Ping timeout: 260 seconds | 08:35 | |
| dmitrey (~quassel@77.121.195.200) joined #pypy. | 08:55 | |
| squiddy (~squiddy@g224197211.adsl.alicedsl.de) joined #pypy. | 08:58 | |
| amaury_ | Is geninterp still used somewhere? | 09:01 |
| dmitrey (~quassel@77.121.195.200) left irc: Remote host closed the connection | 09:17 | |
| antocuni (~antocuni@host62-122-dynamic.6-79-r.retail.telecomitalia.it) joined #pypy. | 09:18 | |
| kenaan | 12arigo default 1115600a1bc7ca 15/pypy/jit/codewriter/assembler.py: Tweak to ignore all Symbolics, not just some of them, by ignoring the TypeError when trying to compare them with sm... | 09:26 |
| kenaan | 12arigo default 117cdc8cea91ab 15/pypy/jit/codewriter/assembler.py: Fix: keep the original special-cases. Needed at least for ComputedIntSymbolics, otherwise they might force computa... | 09:26 |
| kenaan | 12arigo default 11451261ed7b89 15/pypy/rlib/rstacklet.py: Baaaaaah. "Fix" issue1020. | 09:26 |
| CIA-6 | 03arigo 07roundup * 10#1020/segfault when running test_greenlet.py through pypy pytest.py: | 09:27 |
| CIA-6 | [invalid] Baaaah. Closed as invalid. It's a level issue: the test tries to run by | 09:27 |
| CIA-6 | calling directly the C function stacklet_switch(), it's not a ... * 14https://bugs.pypy.org/issue1020 | 09:27 |
| `fox` (~fox@adsl211-124.aknet.it) joined #pypy. | 09:31 | |
| hruske (~Gasper@2001:15c0:66e9:14:8c7d:23ff:fe29:db3a) joined #pypy. | 09:43 | |
| hruske (~Gasper@2001:15c0:66e9:14:8c7d:23ff:fe29:db3a) left irc: Client Quit | 09:43 | |
| fijal (~fijal@196-210-150-33.dynamic.isadsl.co.za) left irc: Ping timeout: 272 seconds | 09:56 | |
| fijal (~fijal@196-210-150-33.dynamic.isadsl.co.za) joined #pypy. | 10:11 | |
| mikefc (~mike@60-242-240-196.static.tpgi.com.au) joined #pypy. | 10:15 | |
| kenaan | 12arigo miniscan 11e50b47052be5 15/: A branch to try to play with conservative root scanning, as a 3rd option to asmgcc-vs-shadowstack. | 10:20 |
| kenaan | 12arigo miniscan 1131b709ec2998 15/pypy/: In-progress. | 10:20 |
| fijal | hehe :) | 10:21 |
| amaury_ | "conservative" like boehm? | 10:26 |
| mwhudson_ (~mwh@121-73-77-183.cable.telstraclear.net) joined #pypy. | 10:38 | |
| dmitrey (~quassel@77.121.195.200) joined #pypy. | 10:38 | |
| fijal | http://www.youtube.com/watch?v=GjnRLG8ATn4 | 10:39 |
| mwhudson_ (~mwh@121-73-77-183.cable.telstraclear.net) left irc: Client Quit | 10:42 | |
| arigato (~arigo@xdsl-188-154-145-222.adslplus.ch) joined #pypy. | 11:02 | |
| fijal | arigato: aha! | 11:10 |
| fijal | hi armin :) | 11:10 |
| arigato | hi | 11:12 |
| fijal | what's your plan with miniscan? | 11:13 |
| fijal | and did you pinpoint the segfault with greenlets by chance? | 11:13 |
| Action: fijal watches http://www.youtube.com/watch?v=GjnRLG8ATn4 | 11:13 | |
| fijal | talk by dabeaz about pypy | 11:13 |
| arigato | greenlet: yes, see issue1020 and 451261ed7b89 | 11:15 |
| fijal | eh no the other one? | 11:16 |
| fijal | let me fish | 11:16 |
| arigato | then no | 11:16 |
| arigato | miniscan: get rid of both shadowstack and asmgcc, and do conservative scanning of the stack roots | 11:16 |
| fijal | https://bugs.pypy.org/issue995 | 11:16 |
| dmitrey (~quassel@77.121.195.200) left irc: Ping timeout: 276 seconds | 11:16 | |
| fijal | this is also interesting potentially but not release critical | 11:16 |
| fijal | conservative = like boehm? | 11:16 |
| arigato | issue995: that's not about greenlets at all? | 11:17 |
| CIA-6 | 03fijal 07roundup * 10#1009/numpypy ndarray bug "TypeError: 'flatiter' object is not subscriptable": [resolved] Fixed. * 14https://bugs.pypy.org/issue1009 | 11:17 |
| fijal | no no, just browsing issues | 11:17 |
| derdon (~derdon@pD9E1D731.dip.t-dialin.net) joined #pypy. | 11:17 | |
| CIA-6 | 03fijal 07roundup * 10#1006/numpypy array(1).reshape(1,1) fails: [resolved] Fixed * 14https://bugs.pypy.org/issue1006 | 11:17 |
| arigato | "did you pinpoint the segfault with greenlets by chance?" "yes" | 11:17 |
| arigato | any other meaning that you may have implied has been lost :-) | 11:18 |
| fijal | hehe | 11:19 |
| fijal | ok I think I'm confused | 11:19 |
| fijal | as in there was one bug while I thought there were two | 11:19 |
| fijal | can we close this: https://bugs.pypy.org/issue985 btw? | 11:19 |
| arigato | ah there is issue1016 | 11:20 |
| arigato | didn't look so far | 11:20 |
| fijal | ah yes | 11:20 |
| fijal | that's the one I was thinking about :) | 11:20 |
| fijal | indeed | 11:20 |
| mrsipan_ (~ben@ip98-163-95-196.dc.dc.cox.net) left irc: Ping timeout: 245 seconds | 11:21 | |
| arigato | issue985: I would like actually hakanardo to have a look | 11:21 |
| nirbheek (~nirbheek@gentoo/developer/flyingspaghettimonster/nirbheek) left irc: Ping timeout: 245 seconds | 11:22 | |
| arigato | I'm unsure why the jit optimizer decides that all loops are invalid, so it keeps tracing forever | 11:22 |
| fijal | meh, I have to reboot the wifi router, wait | 11:22 |
| fijal_ (~fijal@196.215.151.81) joined #pypy. | 11:26 | |
| fijal_ | back | 11:26 |
| fijal_ | and there si also this: https://bugs.pypy.org/issue978 | 11:26 |
| fijal_ | but I was not able to compile converge vm last time I tried | 11:26 |
| arigato | I don't know | 11:27 |
| fijal (~fijal@196-210-150-33.dynamic.isadsl.co.za) left irc: Ping timeout: 276 seconds | 11:27 | |
| fijal_ | ok, I can give a look ath that | 11:27 |
| Nick change: fijal_ -> fijal | 11:27 | |
| arigato | it's not release-critical, if that's the question: | 11:29 |
| fijal | it's not | 11:29 |
| arigato | Converge was great in finding bugs in the jit, but always bugs that didn't happen for pypy | 11:29 |
| fijal | of course that does not prove anything | 11:29 |
| fijal | but yes, it's very likely not release critical | 11:30 |
| fijal | it does not prove anything only in the boring sense :) | 11:30 |
| fijal | so conservative = like boehm right (about the GC) | 11:30 |
| arigato | yes, although only from the stack --- of course inter-object references are exact | 11:33 |
| fijal | ok | 11:33 |
| fijal | so you would "just" scan the entire stack without worrying about types? | 11:34 |
| arigato | basically I realized I made a mistake when considering such solutions | 11:34 |
| arigato | I thought it would create a larger and larger number of pinned objects kept alive on "maybe" grounds | 11:34 |
| arigato | but that's not true, because these objects are bounded by the size of the stack | 11:35 |
| fijal | well | 11:35 |
| fijal | and objects kept by them | 11:35 |
| arigato | sure | 11:35 |
| fijal | so in theory they are unbound | 11:35 |
| arigato | in this sense, yes | 11:35 |
| fijal | but in practice they're faily bound | 11:35 |
| fijal | fairly | 11:35 |
| arigato | yes, we would just scan the entire stack | 11:35 |
| fijal | sounds simple enough | 11:35 |
| fijal | what can go wrong.... | 11:36 |
| arigato | :-) | 11:36 |
| fijal | do you still need special stuff, like closing/reclosing stack? | 11:36 |
| arigato | "optionally" | 11:36 |
| fijal | otherwise you scan the entire C stack with "too bad" approach? | 11:36 |
| arigato | yes | 11:36 |
| nirbheek (~nirbheek@gentoo/developer/flyingspaghettimonster/nirbheek) joined #pypy. | 11:36 | |
| fijal | are all registers somewhere on stack when you do the call to say malloc? | 11:37 |
| arigato | closing/reopening the stack should be fairly easy given that we already have the necessary code, | 11:37 |
| fijal | I think so | 11:37 |
| arigato | but even that should be weighted | 11:37 |
| arigato | it costs something performance-wise | 11:37 |
| arigato | e.g. in a jitted function that does tons of calls to tiny C functions | 11:37 |
| arigato | fijal: not necessarily, that's why we need one line of custom assembler | 11:38 |
| fijal | well I think it's relatively safe to assume "most C calls are shallow" | 11:38 |
| fijal | ok, which registers are not on stack? | 11:38 |
| arigato | there are registers which are callee-save | 11:39 |
| fijal | but the callee saves them on the stack if it decides to use them no? | 11:39 |
| arigato | in theory you can have a gcptr in such a register that stays in the register for all the duration of the malloc() | 11:39 |
| fijal | ah I see | 11:39 |
| arigato | yes | 11:39 |
| fijal | sounds like a very-unlikely-yet-fatal-bug if you forget | 11:39 |
| arigato | yes | 11:39 |
| fijal | can you only store them if you collect or also when you malloc? | 11:40 |
| arigato | (but maybe not that unlikely on 64-bit, where there are more registers) | 11:40 |
| arigato | it's fine if it's done only when we malloc | 11:40 |
| arigato | sorry | 11:40 |
| arigato | only when we collect | 11:40 |
| fijal | ok | 11:40 |
| Da_Blitz | woah, i had no idea pypy ran on crushed up grad students souls | 11:40 |
| fijal | that sounds like "what can go wrong" strategy | 11:40 |
| arigato | yes, please continue to come up with points that could go wrong :-) | 11:41 |
| fijal | I'm just thinking loud :) | 11:41 |
| fijal | so far | 11:41 |
| arigato | the point is that I think in total it's not that much | 11:41 |
| fijal | I would not be against killing stuff like asmgcc btw :) | 11:42 |
| arigato | me too :-) | 11:42 |
| arigato | we'll see how this scanning strategy turns out | 11:43 |
| lucian_ (~lucian@cpc1-newc15-2-0-cust84.gate.cable.virginmedia.com) joined #pypy. | 11:43 | |
| fijal | it seems like something that can be improved by say a gcc plugin | 11:44 |
| fijal | so convervative, but not conservative with a gcc plugin | 11:44 |
| fijal | (for example) | 11:44 |
| fijal | or clang | 11:44 |
| fijal | that sounds better than shadowstack-or-gcc-plugin | 11:45 |
| kenaan | 12fijal default 11534391d69807 15/pypy/module/micronumpy/tool/numready/main.py: a missing space | 11:48 |
| fijal | arigato: indeed, sorry, but what can potentially go wrong is all I can think about :) | 11:52 |
| lucian_ (~lucian@cpc1-newc15-2-0-cust84.gate.cable.virginmedia.com) left irc: Ping timeout: 276 seconds | 11:52 | |
| fijal | how do you determine whether an object is a pointer or not? | 11:52 |
| fijal | or more precisely - how do you determine that you *can* read the value of a pointer? (it is in your heap) | 11:53 |
| arigato | "in our heap" means either it's in the nursery, or it is externally malloced, or it is handled by minimarkpage | 11:54 |
| arigato | we have a list of externally malloced objects somewhere, which maybe we need to turn into a set | 11:55 |
| fijal | so can you precisely say "this is my pointer" somehow? | 11:55 |
| paranoidi | fijal: darn, the flexget bootstrap runs out of file handles even with --distribute ;P | 11:55 |
| arigato | well you can say "here is some random value: is it really a pointer?" | 11:55 |
| fijal | arigato: I mean "is it my pointer" | 11:55 |
| arigato | "my" pointer? | 11:56 |
| fijal | as in "does it point to a valid object allocated by pypy" | 11:56 |
| arigato | yes, I mean that too | 11:56 |
| fijal | ok | 11:56 |
| fijal | because 0x1245 is a pointer as well :) | 11:56 |
| fijal | how do you tell that with minimarkpage? | 11:56 |
| arigato | "here is some random value: is it really a pointer to a valid object?" | 11:56 |
| fijal | yes precisely | 11:56 |
| arigato | with minimarkpage you can answer the question too, a bit indirectly: | 11:57 |
| arigato | if p not in one of the arenas, False | 11:57 |
| arigato | else we look on which page it points | 11:58 |
| arigato | we read the page objects' size in the page header | 11:58 |
| fijal | and you count ok | 11:58 |
| fijal | well that can potentially be slow | 11:58 |
| arigato | and we compute if the pointer is really pointing to an object and not somewhere between | 11:58 |
| fijal | but I suppose you can do a number of easy reductions | 11:58 |
| fijal | like "it has to be dividably by 8" or so | 11:58 |
| arigato | yes, a bit slow, but that's all right because it's only needed for stack roots | 11:58 |
| arigato | yes | 11:59 |
| JaRoel|4d (~jaroel|4d@2001:980:7133:1:919:5f47:a0f:f931) joined #pypy. | 11:59 | |
| fijal | you can probably do tricks | 11:59 |
| fijal | like cache stack every X calls | 11:59 |
| arigato | I don't think we really care | 11:59 |
| fijal | and use caches if your stack didn't go up enough | 11:59 |
| fijal | but yes, sure | 11:59 |
| arigato | for minor collections anyway, we only care about nursery pointers | 12:00 |
| fijal | right | 12:00 |
| fijal | actually | 12:00 |
| fijal | that would be useful for other stuff as well no? | 12:00 |
| arigato | like? | 12:00 |
| fijal | only scan stack Y frames up because we know there are no nursery pointers above that | 12:00 |
| arigato | yes, but it needs the invalidate the caches at the right moment | 12:01 |
| fijal | although I think stack scanning takes so little time % wise of nursery collect it's not really worth it | 12:01 |
| fijal | it never popped in my profiles at least | 12:01 |
| arigato | no, it's roughly 20% of the nursery collect time | 12:01 |
| berdario (~Tiibiidii@host142-83-dynamic.2-87-r.retail.telecomitalia.it) joined #pypy. | 12:02 | |
| fijal | uh ok | 12:02 |
| arigato | ah, not exactly | 12:02 |
| fijal | then maybe at specific places (portal?) it makes sense to have a list of nursery pointers above this frame | 12:03 |
| arigato | 20% is the time scanning the stack and copying the objects directly referenced out of the nursery | 12:03 |
| fijal | ah well it depends on the survival rate | 12:03 |
| arigato | the rest 80% is copying the indirect references | 12:03 |
| fijal | well easy | 12:03 |
| fijal | (for nursery only) | 12:03 |
| fijal | per portal you store the flag "nursery pointers above this frame" | 12:04 |
| arigato | (running translate, or translate --annotate, I don't remember which) | 12:04 |
| fijal | and you invalidate it each time you return | 12:04 |
| fijal | if you do nursery collect you mark all the portals on your stack "no" | 12:04 |
| fijal | and then at nursery collect you only go up to the point where it says "no" | 12:04 |
| arigato | yes, something like that might work, but it is unclear how much you win | 12:05 |
| fijal | it's very easy to do with shadowstack at least | 12:05 |
| arigato | certainly not 20% | 12:05 |
| fijal | of course, you don't know until you try :) | 12:05 |
| fijal | but it sounds very easy | 12:05 |
| arigato | because you win only scanning of objects that don't need to be copied out of the nursery | 12:05 |
| fijal | you might win something, but it's unclear | 12:06 |
| fijal | you certainly win if you have deep stack that does not change much | 12:06 |
| fijal | sounds relatively common | 12:06 |
| fijal | obviously if your loop does not allocate you win nothing | 12:06 |
| arigato | yes, with shadowstack it's easy to hack something like "push a special marker word in the shadowstack" | 12:06 |
| fijal | yes | 12:07 |
| arigato | during minor collection you replace it with a different marker word | 12:07 |
| arigato | and that's it basically | 12:07 |
| fijal | you can do it with say asmgcc or miniscan by having a little piece of assembler that stores a marker on the stack always below portal | 12:07 |
| arigato | not with miniscan, because you don't know what a marker is | 12:08 |
| fijal | so portal is one extra stack depth (as in one word) and you push and pop at entry/exit | 12:08 |
| fijal | but you know with miniscan what sort of function it is no? | 12:08 |
| arigato | no, you look at the stack as an array of words | 12:08 |
| fijal | ok | 12:08 |
| fijal | you can probably have a corresponding structure (like a shadowstack) that's much shallower | 12:09 |
| fijal | that contains only portal calls and have markers | 12:09 |
| fijal | does not sound like a big overhead | 12:09 |
| arigato | ah, maybe | 12:09 |
| arigato | but then you need the whole structure of shadowstack just to maintain this shallow list | 12:09 |
| fijal | so it would contain say stack relative offset or 0 or something like that | 12:09 |
| fijal | well not the whole | 12:09 |
| fijal | because it's much smaller | 12:09 |
| fijal | or you mean the entire complexity? | 12:10 |
| arigato | yes | 12:10 |
| fijal | I don't think you need the entire complexity because it seems like it's expresable by a simple graph transform | 12:10 |
| fijal | but how about we measure with shadowstack and make judgements? | 12:11 |
| arigato | that's stupid, because we can also have a stack marker like 3 or 4 "magic" words long | 12:11 |
| arigato | but risk very, very, very, very rare segfaults | 12:11 |
| whyking (~quassel@ip68-14-13-208.ri.ri.cox.net) joined #pypy. | 12:11 | |
| paranoidi | fijal: I was trying to see if issue 996 was fixed, but it still crashed to mysterious db issues and oddly violates our (badly implemented) single Manager instance only rules in unit tests. Also the only test that does not require database runs much slower with pypy, 1.4s vs 0.4s ;P | 12:12 |
| fijal | as long as chances are smaller than being hit by a meteor I'm fine | 12:12 |
| arigato | fijal: yes, or the chances of the computer miscomputing something | 12:12 |
| fijal | arigato: yes :) | 12:12 |
| arigato | but then we need a bit of care | 12:12 |
| fijal | arigato: you know that the algorithm checking "is this number prime" is probabilistic right? | 12:12 |
| arigato | e.g. the 4 magic words should not be stored somewhere and then reloaded on the stack by some unrelated file reader | 12:13 |
| arigato | yes, I know :-) | 12:13 |
| fijal | right | 12:13 |
| fijal | sounds advanced, but if it gives us some win it would be good | 12:13 |
| arigato | yes, maybe :-) | 12:14 |
| fijal | paranoidi: so I need more data I fear | 12:14 |
| paranoidi | fijal: I'm happy to provide, if I can :) | 12:14 |
| fijal | sure go ahead | 12:15 |
| fijal | like a traceback | 12:15 |
| fijal | preferably a small program how to reproduce | 12:15 |
| fijal | it's probably sqlite-ctypes problem | 12:15 |
| fijal | confirming/denying it's a problem with sqlite-ctypes & cpython also helps | 12:15 |
| paranoidi | http://pastie.org/private/bqcik50pic7erpe8k0vg (I don't think this much interests you) | 12:22 |
| fijal | ah well | 12:22 |
| fijal | this is something that's a wontfix | 12:22 |
| fijal | close your files | 12:22 |
| fijal | or make distribute close it's files | 12:22 |
| paranoidi | not mine to close, and last time you recommended distribute, well apparently it sucks too :D | 12:22 |
| dmitrey (~quassel@77.121.195.200) joined #pypy. | 12:24 | |
| paranoidi | http://pastie.org/private/pnp3vx5mnzl2vtgdjsqa | 12:24 |
| fijal | I did not "recommend" | 12:25 |
| fijal | I said "it might be better" | 12:25 |
| fijal | the latter one might sound like also a GC problem | 12:26 |
| paranoidi | dunno, it's trying to create multicolumn index for table like instructed in SQLalchemy documentation | 12:28 |
| paranoidi | tha table "failed" should be present in there | 12:28 |
| arigato | sounds similar to another issue with sql | 12:29 |
| arigato | ah no, sorry, it's issue996 indeed | 12:30 |
| dmitrey | fijal: since issue with flatiter has been fixed, code for diag() and eye() can be taken directly from numpy sources without changes. However, I'm not 100% sure is it compatible with RPython | 12:30 |
| paranoidi | hmm, although we have our own metaclass magic between there a bit .. | 12:30 |
| fijal | dmitrey: if it's python in numpy it does not have to | 12:31 |
| kenaan | 12fijal extradoc 118191a7475814 15/blog/draft/numpy-status-update-2.rst: Another numpy update | 12:31 |
| kenaan | 12fijal extradoc 113745452a2f67 15/blog/draft/numpy-status-update-2.rst: fix link & update | 12:31 |
| fijal | arigato: ^^^ feel like reviewing? | 12:31 |
| paranoidi | oh, indeed, using SQLAlchemy Base instead of our own works | 12:32 |
| fijal | paranoidi: I don't think I have many comments ;-) | 12:33 |
| fijal | I suppose there *might* be a bug somewhere where we're not 100% compatible with some weird metaclass aspect | 12:33 |
| fijal | but also chances are it works by accident and it'll have a relatively low priority | 12:33 |
| fijal | and you kind of have to investigate why exactly it fails | 12:34 |
| PiotrSikora (~none@nginx/adept/piotrsikora) left irc: Excess Flood | 12:36 | |
| PiotrSikora (~none@nginx/adept/piotrsikora) joined #pypy. | 12:37 | |
| kenaan | 12fijal extradoc 11d119c145bdd7 15/blog/draft/numpy-status-update-2.rst: remove info | 12:37 |
| whyking (~quassel@ip68-14-13-208.ri.ri.cox.net) left irc: Read error: Connection reset by peer | 12:38 | |
| arigato | paranoidi: note that issue996 was fixed 5 days ago. does your issue show up even with a recent pypy? | 12:38 |
| arigato | (sorry if you already said so) | 12:38 |
| arigato | fijal: yes, I can review | 12:38 |
| kenaan | 12fijal extradoc 11684e5e859da4 15/blog/draft/numpy-status-update-2.rst: oops, finish the sentence | 12:38 |
| paranoidi | arigato: nope, I think this is another issue .. | 12:39 |
| arigato | ok | 12:39 |
| arigato | note that it's pure python code, at least the interface to sqlite | 12:39 |
| arigato | so it can be debugged "normally", with pdb & friends | 12:39 |
| arigato | fijal: most ufuncs now accept axis parameter (except all and any) | 12:41 |
| arigato | I'm adding the quotes, because without them, it sounds very strange :-) | 12:42 |
| fijal | hahah | 12:42 |
| fijal | ok :) | 12:42 |
| nedbat (~nedbat@python/psf/nedbat) joined #pypy. | 12:42 | |
| kenaan | 12arigo extradoc 114d7cc9f25be7 15/blog/draft/numpy-status-update-2.rst: typotypotypos but otherwise sounds good. | 12:44 |
| arigato | fijal: ^^^ | 12:44 |
| JaRoel|4d (~jaroel|4d@2001:980:7133:1:919:5f47:a0f:f931) left irc: Remote host closed the connection | 12:45 | |
| kenaan | 12arigo extradoc 11d95b8fd7f2dd 15/blog/draft/numpy-status-update-2.rst: one more | 12:45 |
| arigato | sorry, done. | 12:46 |
| fijal | arigato: I had a living-death experience yesterday trying to look how the hell ppc code was rpython in 2007 | 12:47 |
| arigato | zombie code! | 12:48 |
| arigato | uh, I got an obscure idea that's probably not worth it | 12:50 |
| arigato | represent all GC pointers as an odd word, instead of an even one | 12:50 |
| arigato | then the even words are easier to manipulate for tagged integers | 12:51 |
| arigato | and it's easier to check "is the gcref p a valid pointer" by checking that p is odd | 12:51 |
| arigato | (i.e. not null and not a tagged integer) | 12:52 |
| arigato | similarly in the conversative stack scanning, non-odd values can be ruled out | 12:52 |
| arigato | useful because it is likely that some random raw pointer is even | 12:53 |
| kenaan | 12fijal extradoc 1196966961df4d 15/blog/draft/numpy-status-update-2.rst: the last para is a bit pushy, we just started | 12:54 |
| arigato | (it "just" makes gdb debugging even more of a mess) | 12:54 |
| dmitrey (~quassel@77.121.195.200) left irc: Remote host closed the connection | 12:55 | |
| arigato | fijal: I'd keep the first line of the last para | 12:55 |
| arigato | as some conclusion | 12:55 |
| fijal | We hope to provide you with more frequent updates on the progress. | 12:56 |
| fijal | like this one | 12:56 |
| arigato | yes | 12:56 |
| fijal | ok | 12:56 |
| kenaan | 12fijal extradoc 11898fac7cc21a 15/blog/draft/numpy-status-update-2.rst: this probably wasn't supposed to be killed | 12:57 |
| fijal | arigato: post? | 12:59 |
| arigato | that last line is strange anyway :-/ | 12:59 |
| fijal | yes | 12:59 |
| fijal | I have no idea how to summarize it better though | 12:59 |
| nickik (~nick@217.150.233.216) joined #pypy. | 12:59 | |
| arigato | you mean to say that people should expect more frequent updates on the blog I suppose | 13:00 |
| fijal | I would like to have bi-weekly numpy progress reports | 13:00 |
| kenaan | 12l.diekmann default 112cb8ade3aef2 15/pypy/objspace/std/: test and fix for cached empty list with deactivated strategies | 13:01 |
| kenaan | 12l.diekmann default 11a384864c5d6c 15/pypy/module/cpyext/: test and fix for cpyext/listobject.py: PyList_GET_SIZE and PyList_SetItem | 13:01 |
| kenaan | 12l.diekmann default 113607ba0bb92d 15/pypy/objspace/std/listobject.py: decided that a cached empty list is too dangerous and that is is better to live with a sligthly slower empty l... | 13:01 |
| kenaan | 12l.diekmann default 1151eb80cfd760 15/: merge | 13:01 |
| fijal | because I think pypy development process is too opaque | 13:01 |
| fijal | I would try to press anto to do the same about py3k | 13:01 |
| fijal | but he will object | 13:01 |
| kenaan | 12arigo extradoc 11f58b1b95e973 15/blog/draft/numpy-status-update-2.rst: This way maybe? | 13:02 |
| fijal | yes | 13:03 |
| kenaan | 12fijal extradoc 1167dcf04c0397 15/blog/draft/numpy-status-update-2.rst: rst fix; | 13:05 |
| xcombelle (~xcombelle@AToulouse-551-1-110-139.w92-149.abo.wanadoo.fr) joined #pypy. | 13:06 | |
| arigato | cool | 13:10 |
| fijal | posted | 13:10 |
| arigato | the number of posts in January gets near to the record for the last three years (which was always in March, for some reason) | 13:12 |
| fijal | :] | 13:12 |
| fijal | wasn't pycon in/around march? | 13:12 |
| arigato | (the absolute record is June 2008, though) | 13:12 |
| arigato | yes | 13:12 |
| fijal | what happened in June 2008? | 13:12 |
| fijal | arigato: ok, an extreme example | 13:13 |
| fijal | http://paste.pocoo.org/show/542061/ | 13:13 |
| fijal | walk_to_parent_frame takes 35% of total time | 13:13 |
| fijal | this *is* extreme though | 13:14 |
| fijal | 11% in the slightly more reasonable case of 200 call depth | 13:15 |
| arigato (~arigo@xdsl-188-154-145-222.adslplus.ch) left irc: Ping timeout: 252 seconds | 13:17 | |
| arigato (~arigo@xdsl-188-154-145-222.adslplus.ch) joined #pypy. | 13:18 | |
| fijal | arigato: have you seen the stuff I posted? | 13:19 |
| arigato | yes, up to "11% in the slightly..." | 13:19 |
| arigato | I suppose there might be a win, but it's unclear | 13:19 |
| arigato | but it's worth a try given that it's easy | 13:19 |
| fijal | well | 13:20 |
| fijal | 1/3 of a speedup in an extreme case is more than we usually go for ;-) | 13:20 |
| fijal | given the simplicity | 13:20 |
| arigato | ah yes | 13:20 |
| arigato | it means that just scanning the 800 stacks and not copying anything takes (35-11)% of the time | 13:20 |
| arigato | then yes, it's worth it indeed | 13:21 |
| amaury_ | 3 blog posts in 3 days! | 13:21 |
| fijal | amaury_: I have another one in the queue, we're throttling to the limit of 1/day | 13:22 |
| arigato | and cfbolz has "part 2" ready to post, as far as I know :-) | 13:22 |
| fijal | arigato: are you doing the experiment or should I play? note that I have no idea how shadowstack works, so I would happily let you do it ;-) | 13:22 |
| arigato | and I would like to post soonish an stm update too | 13:23 |
| arigato | fijal: how about pair-programming? :-) but after lunch for me | 13:23 |
| fijal | sounds like a plan! | 13:23 |
| arigato | :-) | 13:23 |
| fijal | I'll make some lunch as well | 13:23 |
| fijal | in say 1h? | 13:23 |
| arigato | works for me | 13:27 |
| Action: fijal off for a bit | 13:28 | |
| Action: fijal back | 14:07 | |
| Action: arigato back too | 14:16 | |
| fijal | sure, screen on tannit? | 14:16 |
| arigato | ok | 14:16 |
| fijal | your or mine? | 14:16 |
| arigato | mine, 32bit? | 14:17 |
| arigato | bah | 14:17 |
| arigato | no, 64bit | 14:17 |
| arigato | on 32bit I get as usual "Must run suid root for ..." | 14:17 |
| arigato | -> #pypy-sync | 14:17 |
| gyanyna (gyanyna@188.229.30.170) joined #pypy. | 14:28 | |
| gyanyna | !top | 14:28 |
| gyanyna (gyanyna@188.229.30.170) left #pypy. | 14:29 | |
| nedbat (~nedbat@python/psf/nedbat) left irc: Ping timeout: 276 seconds | 14:32 | |
| dmitrey (~quassel@77.121.195.200) joined #pypy. | 14:46 | |
| aboudreault (~alanb@osgeo/member/aboudreault) joined #pypy. | 14:56 | |
| xcombelle (~xcombelle@AToulouse-551-1-110-139.w92-149.abo.wanadoo.fr) left irc: Ping timeout: 276 seconds | 15:10 | |
| dmitrey (~quassel@77.121.195.200) left irc: Remote host closed the connection | 15:11 | |
| fijal | arigato: shouldn't MARKER_TRACED be already an address? | 15:16 |
| arigato | maybe but it doesn't change anything | 15:18 |
| nedbat (~nedbat@python/psf/nedbat) joined #pypy. | 15:20 | |
| nettok (~quassel@190.148.27.106) joined #pypy. | 15:21 | |
| xcombelle (~xcombelle@AToulouse-551-1-139-30.w86-201.abo.wanadoo.fr) joined #pypy. | 15:21 | |
| Arach (~arach@128-75-163-251.broadband.corbina.ru) left irc: Ping timeout: 255 seconds | 15:22 | |
| nedbat (~nedbat@python/psf/nedbat) left irc: Ping timeout: 248 seconds | 15:26 | |
| inhahe (~inhahe@adsl-074-186-083-219.sip.mia.bellsouth.net) left irc: Ping timeout: 260 seconds | 15:30 | |
| inhahe (~inhahe@adsl-074-186-083-219.sip.mia.bellsouth.net) joined #pypy. | 15:30 | |
| Arach (~arach@128-75-189-245.broadband.corbina.ru) joined #pypy. | 15:33 | |
| xcombelle (~xcombelle@AToulouse-551-1-139-30.w86-201.abo.wanadoo.fr) left irc: Ping timeout: 248 seconds | 15:35 | |
| voidspac_ (~voidspace@87-194-212-65.bethere.co.uk) joined #pypy. | 15:38 | |
| mrsipan_ (~ben@ip98-163-95-196.dc.dc.cox.net) joined #pypy. | 15:42 | |
| mrsipan_ (~ben@ip98-163-95-196.dc.dc.cox.net) left irc: Read error: Operation timed out | 15:45 | |
| xcombelle (~xcombelle@AToulouse-551-1-70-2.w92-146.abo.wanadoo.fr) joined #pypy. | 15:48 | |
| dmitrey (~quassel@77.121.195.200) joined #pypy. | 15:49 | |
| zain (~textual@46.120.28.30) left irc: Ping timeout: 244 seconds | 15:49 | |
| berdario (~Tiibiidii@host142-83-dynamic.2-87-r.retail.telecomitalia.it) left irc: Quit: Ex-Chat | 15:55 | |
| kenaan | 12arigo stackroot-speedup 11641b24e593c6 15/pypy/rpython/: (fijal, arigo) Trying to speed up the stack root walking step of minor collections. The idea is to mark ... | 15:55 |
| kenaan | 12arigo stackroot-speedup 11ecd5a39e368a 15/pypy/rpython/memory/: (fijal, arigo) Pass the flag "is_minor" around. | 15:55 |
| kenaan | 12arigo stackroot-speedup 1120b7b00aefee 15/pypy/: (fijal, arigo) Test in progress. | 15:55 |
| antocuni (~antocuni@host62-122-dynamic.6-79-r.retail.telecomitalia.it) left irc: Ping timeout: 252 seconds | 15:56 | |
| zain (~textual@46.120.28.30) joined #pypy. | 15:57 | |
| xcombelle (~xcombelle@AToulouse-551-1-70-2.w92-146.abo.wanadoo.fr) left irc: Ping timeout: 260 seconds | 16:00 | |
| `fox` (~fox@adsl211-124.aknet.it) left irc: Ping timeout: 255 seconds | 16:01 | |
| pythonirc101 (~pythonirc@c-68-63-40-199.hsd1.fl.comcast.net) joined #pypy. | 16:03 | |
| pythonirc101 | does pyqt, twisted work with pypy on windows? | 16:03 |
| pythonirc101 | can pyinstaller use it? does anyone know? | 16:04 |
| voidspac_ (~voidspace@87-194-212-65.bethere.co.uk) left irc: Quit: Goodbye... | 16:05 | |
| amaury_ | pythonirc101: Twisted works, but IIRC the installer fails | 16:05 |
| amaury_ | because some optional extension module cannot be built | 16:06 |
| fijal | it was fixed in the recent release IMO | 16:06 |
| pythonirc101 | what about pyqt? pyinstaller? | 16:06 |
| fijal | pyqt does not work | 16:06 |
| fijal | pyinstaller - never heard | 16:06 |
| pythonirc101 | py2freeze ? | 16:07 |
| pythonirc101 | py2exe | 16:07 |
| fijal | probably not | 16:08 |
| pythonirc101 | I downloaded pypy.zip , how do I run a python program using it? | 16:08 |
| amaury_ | pyqt won't work because it's based on the SIP wrapper, which is too complex to be compiled for pypy | 16:08 |
| amaury_ | I tried to modify it, but SIP has no unit test :-(( | 16:09 |
| fijal | amaury_: the SIP wrapper is not hand written | 16:09 |
| fijal | it's auto-generated | 16:09 |
| pythonirc101 | well, don't worry about it, someday in the future, pyqt will die... :) | 16:09 |
| fijal | adn the generation tool is not open source | 16:09 |
| amaury_ | fijal: the "siplib", then | 16:09 |
| amaury_ | containing base types | 16:10 |
| amaury_ | siplib.c defines tp_alloc for a meta class | 16:10 |
| amaury_ | which is beyond cpyext capabilities | 16:10 |
| amaury_ | there is certainly a way to rewrite this | 16:10 |
| amaury_ | (metaclasses are not really useful in generated code) | 16:11 |
| fijal | no I mean not the SIP itself | 16:11 |
| fijal | but the QT SIP wrapper | 16:11 |
| derdon_ (~derdon@p5DE8B2C1.dip.t-dialin.net) joined #pypy. | 16:12 | |
| pythonirc101 | in my pypy\bin direcotyr I only see ".py" files. Do I need to execute them using python 272 interpreter? | 16:12 |
| amaury_ | pythonirc101: please download a prebuilt version | 16:12 |
| amaury_ | fijal: I'm not sure to understand | 16:13 |
| pythonirc101 | amaury_: not the jit compiler version? | 16:13 |
| xcombelle (~xcombelle@AToulouse-551-1-96-188.w92-149.abo.wanadoo.fr) joined #pypy. | 16:13 | |
| amaury_ | pythonirc101: did you download the source files, or clone the repository? | 16:14 |
| amaury_ | if so, you'll have to translate/compile pypy yourself | 16:14 |
| amaury_ | which is a pain | 16:14 |
| pythonirc101 | I downloaded a zip file. I'm now downloading the nigthly trunk -- pypy-c-jit-latest-win32.zip | 16:14 |
| pythonirc101 | got it, this one worked | 16:15 |
| derdon (~derdon@pD9E1D731.dip.t-dialin.net) left irc: Ping timeout: 252 seconds | 16:15 | |
| pythonirc101 | is there a setuptools for it that I can get? pip for instance? | 16:15 |
| berdario (~Tiibiidii@host142-83-dynamic.2-87-r.retail.telecomitalia.it) joined #pypy. | 16:16 | |
| fijal | pythonirc101: you create a virtualenv with pypy and you get it | 16:16 |
| fijal | new virtualenv works as does new pip | 16:16 |
| pythonirc101 | fijal: on windows how do I get virtualenv? | 16:17 |
| fijal | pythonirc101: no idea | 16:17 |
| pythonirc101 | Are we assuming I've another python installed? | 16:17 |
| fijal | pythonirc101: download it from somewhere | 16:17 |
| fijal | virtualenv has -p parameter | 16:17 |
| mattip (~mattip@bzq-79-177-109-132.red.bezeqint.net) joined #pypy. | 16:19 | |
| mattip | fijal: merged, translated (nightly) and even blogged! Thanks :) | 16:20 |
| mattip | (fixed too, I see) | 16:20 |
| fijal | :] | 16:21 |
| pythonirc101 | is pywin32 usable on pypy yet? | 16:22 |
| fijal | no | 16:22 |
| pythonirc101 | pyinstaller / py2exe need that | 16:22 |
| fijal | well, they also don't work for another reasons | 16:22 |
| pythonirc101 | lets say I've a script that works with pypy | 16:23 |
| pythonirc101 | how can I convert it to ".exe" file to distribute? | 16:23 |
| fijal | you cannot | 16:23 |
| fijal | at least not without investing some work | 16:23 |
| amaury_ | fijal: I was talking of this tool http://www.riverbankcomputing.co.uk/software/sip/intro | 16:24 |
| fijal | I mean you can always have a .bat script that has pypy & a .py file no? | 16:24 |
| pythonirc101 | currently all users of pypy only keep their scripts in house? no distributions? | 16:24 |
| fijal | pythonirc101: we do distribute stuff via say eggs | 16:24 |
| fijal | or as python files! | 16:24 |
| fijal | distributing python binary with every simple python file is a very windows concept | 16:24 |
| fijal | it does not even exist on linux | 16:24 |
| pythonirc101 | fijal: is pypy+script+a.py the right way to distribute pypy scripts right now? | 16:24 |
| fijal | pythonirc101: I would say "no" as in I don't think distributing a python binary with every single python file a very good way to go about it | 16:25 |
| fijal | (if you ask me about a personal opinion) | 16:25 |
| fijal | pythonirc101: not sure a bit what you're trying to achieve btw | 16:26 |
| pythonirc101 | we distribute an "executable" app right now using py2exe. I think we'll have to wait till pypy gets there? | 16:26 |
| fijal | pythonirc101: you can just package it by hand if you want to | 16:27 |
| pythonirc101 | you mean in a ".bat" file? sounds like a hack to me -- and not the right way. | 16:28 |
| fijal | and py2exe isn't a hack? | 16:28 |
| fijal | py2exe does essentially the same thing | 16:28 |
| aboudreault (~alanb@osgeo/member/aboudreault) left irc: Quit: Leaving | 16:32 | |
| mattip (~mattip@bzq-79-177-109-132.red.bezeqint.net) left irc: Quit: Leaving | 16:40 | |
| ixokai (~ixokai@rrcs-24-199-8-246.west.biz.rr.com) joined #pypy. | 16:42 | |
| ixokai (~ixokai@rrcs-24-199-8-246.west.biz.rr.com) left irc: Changing host | 16:42 | |
| ixokai (~ixokai@pdpc/supporter/student/ixokai) joined #pypy. | 16:42 | |
| Unhelpful (~quassel@rockbox/developer/Unhelpful) left irc: Quit: http://quassel-irc.org - Chat comfortably. Anywhere. | 16:45 | |
| Arfrever (~Arfrever@apache/committer/Arfrever) left irc: Read error: Connection reset by peer | 16:45 | |
| Unhelpful (~quassel@rockbox/developer/Unhelpful) joined #pypy. | 16:46 | |
| amaury_ | fijal: no, py2exe can do everything in memory | 16:46 |
| amaury_ | even load .pyd and .dll | 16:46 |
| fijal | yes, it glues it together | 16:47 |
| `fox` (~fox@host65-111-dynamic.30-79-r.retail.telecomitalia.it) joined #pypy. | 16:49 | |
| ronan__ (~ronan@host86-172-62-103.range86-172.btcentralplus.com) left irc: Ping timeout: 276 seconds | 16:53 | |
| ronan__ (~ronan@host86-133-141-22.range86-133.btcentralplus.com) joined #pypy. | 16:53 | |
| Arfrever (~Arfrever@apache/committer/Arfrever) joined #pypy. | 16:54 | |
| amaury_ | <spam> | 16:56 |
| kenaan | 12amauryfa py3k 1107a52ec2616d 15/pypy/objspace/std/test/test_listobject.py: range() is not a list anymore, and objspace.std.withrangelist was removed | 16:57 |
| kenaan | 12amauryfa py3k 11732d082457bf 15/pypy/objspace/std/test/test_listobject.py: Fix remaining failures in test_listobject. | 16:57 |
| kenaan | 12amauryfa py3k 11d6dfa54f243c 15/pypy/translator/test/: Fix geninterp tests, and give up with the unicode tests: Parsing 2.x code to build 3.x operations is not a good ide... | 16:57 |
| kenaan | 12amauryfa py3k 118f7805107a60 15/pypy/objspace/: Fix tests for the Thunk Object Space | 16:57 |
| kenaan | 12amauryfa py3k 11975692f436ef 15/pypy/objspace/std/test/: Fix tuple tests | 16:57 |
| kenaan | 12amauryfa py3k 1171d4eb2be749 15/pypy/objspace/std/test/: Fix most of test_long | 16:57 |
| kenaan | 12amauryfa py3k 1126e3b9127ae8 15/pypy/objspace/std/test/test_index.py: Easy fixes in test_index | 16:57 |
| kenaan | 12amauryfa py3k 11f665d2b4c34d 15/pypy/module/sys/test/test_sysmodule.py: Fixes in test_sysmodule | 16:57 |
| kenaan | 12amauryfa py3k 111ff9e2433ebb 15/pypy/module/: Remove sys.setdefaultencoding | 16:57 |
| kenaan | 12amauryfa py3k 1191c9b2c580d9 15/: Fix all tests in the io module. | 16:57 |
| amaury_ | </spam> | 16:57 |
| Shanita (~John@osbk-4db1576f.pool.mediaWays.net) left irc: Read error: Connection reset by peer | 17:00 | |
| Kaskuka (~John@osbk-4db1576f.pool.mediaWays.net) joined #pypy. | 17:03 | |
| Rhyolite (~dje@pool-108-6-25-71.nycmny.fios.verizon.net) left irc: Quit: Leaving | 17:11 | |
| Rhyolite (~dje@pool-108-6-25-71.nycmny.fios.verizon.net) joined #pypy. | 17:14 | |
| `fox` (~fox@host65-111-dynamic.30-79-r.retail.telecomitalia.it) left irc: Read error: Connection reset by peer | 17:14 | |
| `fox` (~fox@host65-111-dynamic.30-79-r.retail.telecomitalia.it) joined #pypy. | 17:14 | |
| fijal | http://lambda-the-ultimate.org/node/4440 | 17:24 |
| nedbat (~nedbat@python/psf/nedbat) joined #pypy. | 17:27 | |
| `fox` (~fox@host65-111-dynamic.30-79-r.retail.telecomitalia.it) left irc: Read error: Connection reset by peer | 17:31 | |
| JaRoel|4d (~jaroel|4d@82-169-48-80.ip.telfort.nl) joined #pypy. | 17:32 | |
| `fox` (~fox@host65-111-dynamic.30-79-r.retail.telecomitalia.it) joined #pypy. | 17:32 | |
| tito_ (~tito@178.73.216.222) joined #pypy. | 17:33 | |
| tito (~tito@178.73.216.222) left irc: Ping timeout: 248 seconds | 17:36 | |
| JaRoel|4d (~jaroel|4d@82-169-48-80.ip.telfort.nl) left irc: Remote host closed the connection | 17:39 | |
| `fox` (~fox@host65-111-dynamic.30-79-r.retail.telecomitalia.it) left irc: Ping timeout: 255 seconds | 17:41 | |
| mattip (~mattip@bzq-79-177-109-132.red.bezeqint.net) joined #pypy. | 17:41 | |
| lucian (~lucian@cpc1-newc15-2-0-cust84.gate.cable.virginmedia.com) joined #pypy. | 17:43 | |
| pedronis_ (~pedronis@73-53.195-178.cust.bluewin.ch) joined #pypy. | 17:46 | |
| vad (~vad@host117-105-dynamic.30-79-r.retail.telecomitalia.it) joined #pypy. | 17:47 | |
| pedronis (~pedronis@73-53.195-178.cust.bluewin.ch) left irc: Ping timeout: 255 seconds | 17:48 | |
| kenaan | 12mattip matrixmath-dot 1157b13475b99a 15/: merge from default | 17:51 |
| kenaan | 12mattip matrixmath-dot 11cb8369cbce6f 15/pypy/module/micronumpy/: cleanup after merge, all tests pass | 17:52 |
| vad (~vad@host117-105-dynamic.30-79-r.retail.telecomitalia.it) left irc: Remote host closed the connection | 17:54 | |
| JaRoel|4d (~jaroel|4d@82-169-48-80.ip.telfort.nl) joined #pypy. | 17:55 | |
| mattip | fijal: ping | 17:55 |
| shiftingcontrol (~kracekuma@101.63.179.97) joined #pypy. | 17:56 | |
| fijal | mattip: pongish | 17:56 |
| mattip | matrixmath-dot passes tests, it has a jit_merge_point and zjit tests. | 17:57 |
| mattip | It needs more diabolical corner case tests. | 17:57 |
| mattip | can you take a look over the next coupla days? | 17:57 |
| fijal | ya | 17:58 |
| mattip | I thought we should benchmark our current work against plain pypy, against plain python, and against numpy. | 17:58 |
| fijal | with whay? | 17:59 |
| fijal | what? | 17:59 |
| mattip | would there be any interest in me rewriting the video processing test done in July? | 17:59 |
| fijal | in numpy? | 17:59 |
| mattip | it seems someone else started: https://github.com/pablomouzo/pypy-image-demo | 17:59 |
| fijal | or in vectorized numpy? | 17:59 |
| mattip | yes, the whole hog (numpy+scipy) or even opencv | 18:00 |
| JaRoel|4d (~jaroel|4d@82-169-48-80.ip.telfort.nl) left irc: Remote host closed the connection | 18:00 | |
| mattip | If we set the bar high we'll know how far we have to go. | 18:00 |
| fijal | feel free to do something, I'm not *that* interested until we do SSE | 18:01 |
| mattip | ok, I'll wait. | 18:02 |
| lucian | SSE support in numpy would be so awesome | 18:05 |
| fijal | mattip: I mean you're more than free to benchmark now | 18:05 |
| fijal | it's more "I won't do it" than "I don't want you to do it" | 18:06 |
| lucian | the only other high-level runtime that does that is Mono afaik | 18:06 |
| fijal | that would not be for the whole python though | 18:06 |
| fijal | I think | 18:06 |
| mattip | ok, I'll give it some thought. | 18:09 |
| fijal | mattip: it's good to have jitviewer ready btw | 18:10 |
| kenaan | 12arigo stackroot-speedup 1151157f562a0f 15/pypy/rpython/memory/gctransform/test/test_framework.py: (fijal, arigo) Finish the test. Argh, painful :-( | 18:30 |
| kenaan | 12arigo stackroot-speedup 11e23446a82e4e 15/pypy/rpython/memory/gctransform/framework.py: (fijal, arigo) Fix the framework transformer to let it insert the MARKER_NOT_TRACED into the shadowstack... | 18:30 |
| kenaan | 12arigo default 11256d3279bde5 15/pypy/: Reduce the number of cases of shadowstack root walking: from 4 (jit/nojit, thread/nothread) to 2 (thread/nothread). | 18:30 |
| kenaan | 12arigo stackroot-speedup 11d12ecbdb1018 15/pypy/: hg merge default (loosing the changes done so far to shadowstack; will be re-applied in the next checkin) | 18:30 |
| kenaan | 12arigo default 11f0d095a1d379 15/pypy/: (fijal, arigo) Change the order of the shadowstack processing. We now process it right-to-left instead of left-to... | 18:30 |
| kenaan | 12arigo stackroot-speedup 1122439f4f3761 15/pypy/: hg merge default | 18:30 |
| kenaan | 12arigo stackroot-speedup 11d160dc0c193a 15/pypy/rpython/memory/gctransform/: (fijal, arigo) add support for MARKER_TRACED that was lost during the merge | 18:30 |
| shiftingcontrol (~kracekuma@101.63.179.97) left irc: Remote host closed the connection | 18:34 | |
| Transformer (~Transform@ool-4a59e397.dyn.optonline.net) joined #pypy. | 18:36 | |
| Transformer (Transform@ool-4a59e397.dyn.optonline.net) left #pypy. | 18:37 | |
| intchanter (~intchante@c-76-27-100-38.hsd1.ut.comcast.net) left irc: Ping timeout: 245 seconds | 18:40 | |
| intchanter (~intchante@c-76-27-100-38.hsd1.ut.comcast.net) joined #pypy. | 18:43 | |
| ixokai_ (~ixokai@rrcs-24-199-8-246.west.biz.rr.com) joined #pypy. | 18:43 | |
| ixokai_ (~ixokai@rrcs-24-199-8-246.west.biz.rr.com) left irc: Changing host | 18:43 | |
| ixokai_ (~ixokai@pdpc/supporter/student/ixokai) joined #pypy. | 18:43 | |
| ixokai (~ixokai@pdpc/supporter/student/ixokai) left irc: Ping timeout: 255 seconds | 18:46 | |
| mattip (~mattip@bzq-79-177-109-132.red.bezeqint.net) left irc: Quit: bye | 18:57 | |
| fijal (~fijal@196.215.151.81) left irc: Remote host closed the connection | 19:03 | |
| Trundle (~andy@89.204.130.216) joined #pypy. | 19:03 | |
| Trundle (~andy@89.204.130.216) left irc: Changing host | 19:03 | |
| Trundle (~andy@python/site-packages/trundle) joined #pypy. | 19:03 | |
| fijal (~fijal@196.215.151.81) joined #pypy. | 19:06 | |
| Arfrever (~Arfrever@apache/committer/Arfrever) left irc: Quit: Ex+re | 19:19 | |
| nopper (~nopper@ns.patched.biz) joined #pypy. | 19:23 | |
| Arfrever (~Arfrever@apache/committer/Arfrever) joined #pypy. | 19:29 | |
| vad (~vad@host38-18-dynamic.244-95-r.retail.telecomitalia.it) joined #pypy. | 19:30 | |
| vad (~vad@host38-18-dynamic.244-95-r.retail.telecomitalia.it) left irc: Remote host closed the connection | 19:30 | |
| fprimex (~fprimex@fl-67-233-144-239.dhcp.embarqhsd.net) joined #pypy. | 19:39 | |
| kenaan | 12arigo stackroot-speedup 11ab6b2fd5deb7 15/pypy/: (fijal mostly, arigo review) Adapt the logic to the JIT shadowstack code. | 19:44 |
| kenaan | 12arigo stackroot-speedup 1140fbdea76ec1 15/pypy/jit/backend/llsupport/gc.py: (fijal, arigo) Also replace MARKER_FRAME with a pair of markers: during minor collection, MARKER_FRAME i... | 19:44 |
| kenaan | 12arigo stackroot-speedup 1181fa07721a43 15/pypy/jit/backend/llsupport/gc.py: (fijal, arigo) Performance tweak, maybe | 19:44 |
| vad (~vad@host38-18-dynamic.244-95-r.retail.telecomitalia.it) joined #pypy. | 19:51 | |
| `fox` (~fox@host65-111-dynamic.30-79-r.retail.telecomitalia.it) joined #pypy. | 19:52 | |
| dmitrey (~quassel@77.121.195.200) left irc: Ping timeout: 244 seconds | 20:01 | |
| vad (~vad@host38-18-dynamic.244-95-r.retail.telecomitalia.it) left irc: Remote host closed the connection | 20:06 | |
| rguillebert | hi | 20:08 |
| kenaan | 12amauryfa default 11cf1a8868cf4e 15/pypy/: CPython Issue #13885 (CVE-2011-3389): the _ssl module would always disable the CBC IV attack countermeasure. | 20:08 |
| amaury_ | First pypy security fix :) | 20:09 |
| kenaan | 12amauryfa string-NUL 11ee8a4766b942 15/: A branch to try detection of NUL characters in strings | 20:10 |
| kenaan | 12amauryfa string-NUL 11aa595f8bbf18 15/pypy/annotation/listdef.py: In litsdef.merge(), perform checks before we start modifying the other read locations. This makes debugging ... | 20:10 |
| kenaan | 12amauryfa string-NUL 1156ffa1a912b1 15/pypy/: The NUL byte is now disallowed in many posix functions. We use the annotator to "prove" that a string has no ... | 20:10 |
| `fox` (~fox@host65-111-dynamic.30-79-r.retail.telecomitalia.it) left irc: Ping timeout: 272 seconds | 20:11 | |
| fijal | amaury_: can you merge merge-2.7.2? | 20:12 |
| bbot2 | Started: 15http://buildbot.pypy.org/builders/own-linux-x86-32/builds/1946 [12amaury, string-NUL] | 20:13 |
| Alex_Gaynor | fijal: there's still a few failing tests | 20:13 |
| fijal | can you guys fix them maybe :) | 20:14 |
| amaury_ | the mmap failures are a bit harder than expected | 20:15 |
| amaury_ | it's about LARGE_FILE_SUPPORT even in 32bit | 20:15 |
| arigato | on windows? | 20:15 |
| amaury_ | linux | 20:15 |
| arigato | (because rmmap.py is rather broken for windows) | 20:16 |
| arigato | (in the sense of not being really RPython) | 20:16 |
| amaury_ | but it translates? | 20:16 |
| arigato | yes | 20:16 |
| arigato | but it does strange things like manipulating an int but checking if it fits 32-bits | 20:17 |
| vad (~vad@host38-18-dynamic.244-95-r.retail.telecomitalia.it) joined #pypy. | 20:17 | |
| amaury_ | ah, offset is supposed to be an int64 | 20:17 |
| amaury_ | but probably annotated as Signed | 20:18 |
| vad (~vad@host38-18-dynamic.244-95-r.retail.telecomitalia.it) left irc: Remote host closed the connection | 20:18 | |
| amaury_ | we probably need more unwrap_specs | 20:20 |
| fijal | amaury_: can we not have things like no_NUL | 20:20 |
| fijal | that is mixed cases? | 20:20 |
| amaury_ | Can you rephrase? | 20:20 |
| fijal | no_null | 20:21 |
| fijal | or something would be better | 20:21 |
| fijal | can_be_None is there I know | 20:21 |
| fijal | but I don't like it | 20:21 |
| amaury_ | sure | 20:21 |
| amaury_ | I didn't like it either :) | 20:21 |
| amaury_ | that's why I ended with str0 in other places | 20:22 |
| amaury_ | like "convertible to a nul-terminated string" | 20:22 |
| Action: amaury_ renames | 20:23 | |
| dmitrey (~quassel@77.121.195.200) joined #pypy. | 20:25 | |
| kenaan | 12amauryfa string-NUL 11ad0aa0ec7a90 15/pypy/: Rename to SomeString.no_nul | 20:26 |
| csenger (~user@dslb-084-058-130-062.pools.arcor-ip.net) joined #pypy. | 20:39 | |
| dmitrey (~quassel@77.121.195.200) left irc: Read error: Connection reset by peer | 20:54 | |
| Rhyolite | fijal: pong | 21:02 |
| xcombelle (~xcombelle@AToulouse-551-1-96-188.w92-149.abo.wanadoo.fr) left irc: Quit: I am a manual virus, please copy me to your quit message. | 21:06 | |
| davisagli (~davisagli@davisagli.com) left irc: Excess Flood | 21:09 | |
| davisagli (~davisagli@davisagli.com) joined #pypy. | 21:09 | |
| zain (~textual@46.120.28.30) left irc: Quit: Computer has gone to sleep. | 21:25 | |
| stakkars_ (~tismer@i59F6BDF0.versanet.de) joined #pypy. | 21:26 | |
| bbot2 | 4Failure: 15http://buildbot.pypy.org/builders/own-linux-x86-32/builds/1946 [12amaury, string-NUL] | 21:27 |
| fprimex (~fprimex@fl-67-233-144-239.dhcp.embarqhsd.net) left irc: Quit: Leaving | 21:32 | |
| squiddy (~squiddy@g224197211.adsl.alicedsl.de) left irc: Quit: Leaving | 21:33 | |
| asmeurer_ (~asmeurer@dhcp-altamirano-166.resnet.nmt.edu) joined #pypy. | 21:34 | |
| lucian (~lucian@cpc1-newc15-2-0-cust84.gate.cable.virginmedia.com) left irc: Ping timeout: 255 seconds | 21:43 | |
| price (~price@BUZZWORD-BINGO.MIT.EDU) left irc: Ping timeout: 248 seconds | 21:58 | |
| tilgovi (~randall@couchdb/developer/tilgovi) joined #pypy. | 22:00 | |
| mattip (~mattip@bzq-79-177-109-132.red.bezeqint.net) joined #pypy. | 22:01 | |
| tilgovi (~randall@couchdb/developer/tilgovi) left irc: Remote host closed the connection | 22:03 | |
| mattip | win32 build is still broken, heres the traceback: http://paste.pocoo.org/show/542359 | 22:06 |
| mattip | the error changed with changeset "15600a1bc7ca Tweak to ignore all Symbolics, not just some of them" | 22:08 |
| mattip | arigato: I think you were trying to fix this ^^^^? | 22:09 |
| mattip | it appears that the Assembler has more than 256 insns keys :( | 22:13 |
| mattip | rather: the insns dictionary in Assembler has more than 256 entries | 22:13 |
| amaury_ | mattip: which graph is it? | 22:13 |
| amaury_ | (4 levels up in pdb) | 22:14 |
| mattip | this? <JitCode 'jump_absolute__AccessDirect_None'> | 22:14 |
| mattip | maybe this: | 22:15 |
| mattip | <pypy.jit.codewriter.flatten.SSARepr object at 0x22b394d0> | 22:16 |
| mattip | no, I'll have to go with graph = <FunctionGraph of (pypy.module.pypyjit.interp_jit:82)jump_absolute__AccessDirect_None at 0x2d71d0d0> | 22:17 |
| Action: mattip wishes he understood what is what. | 22:18 | |
| amaury_ | jump_absolute is THE opcode where jitdriver.can_enter_jit() is called | 22:19 |
| mattip | ok, I think I'm with you so far. | 22:20 |
| amaury_ | I won't go further :-/ | 22:21 |
| mattip | could it be that there are more than 256 jitdrivers? | 22:21 |
| amaury_ | huh? | 22:21 |
| amaury_ | ah, one for each numpy function | 22:21 |
| mattip | well, somehow self.write_insn(insn) is adding one-too-many "insn"s to itself | 22:23 |
| mattip | so chr(num) is failing | 22:23 |
| mattip | but I don't understand why this is win32 specific. | 22:24 |
| amaury_ | what are the keys of self.insns? | 22:28 |
| fijal | amaury_: eh, do you feel like explaining on the blog why are you not contracted to work on py3k? | 22:30 |
| mattip | http://paste.pocoo.org/show/542364 | 22:31 |
| amaury_ | fijal: yes | 22:31 |
| mattip | amaury_: would you like me to format it differently? | 22:35 |
| amaury_ | that's O | 22:37 |
| amaury_ | ok | 22:37 |
| berdario (~Tiibiidii@host142-83-dynamic.2-87-r.retail.telecomitalia.it) left irc: Ping timeout: 276 seconds | 22:37 | |
| amaury_ | I'm surprised to see operations like cast_singlefloat_to_float | 22:37 |
| nedbat (~nedbat@python/psf/nedbat) left irc: Ping timeout: 248 seconds | 22:39 | |
| lucian (~lucian@cpc1-newc15-2-0-cust84.gate.cable.virginmedia.com) joined #pypy. | 22:40 | |
| mattip | reformatted and sorted http://paste.pocoo.org/show/542370 | 22:44 |
| JaRoel|4d (~jaroel|4d@sink.jaroel.nl) joined #pypy. | 22:49 | |
| mattip | amaury_: I don't really know what to do, going to sleep and hoping angels fix this seems like the best alternative. | 22:56 |
| arigato | mattip: re traceback of windows build: thanks | 22:57 |
| mattip | arigato: I've still got a pdb prompt at the error, anything more I can do? | 22:58 |
| arigato | yes: p insn? | 22:59 |
| mattip | here are the keys: http://paste.pocoo.org/show/542370/ | 22:59 |
| arigato | ah no | 22:59 |
| arigato | ok | 22:59 |
| bbot2 | Started: 15http://buildbot.pypy.org/builders/jit-benchmark-linux-x86-32/builds/1038 | 23:00 |
| bbot2 | Started: 15http://buildbot.pypy.org/builders/jit-benchmark-linux-x86-64/builds/221 | 23:00 |
| bbot2 | Started: 15http://buildbot.pypy.org/builders/own-macosx-x86-32/builds/790 | 23:00 |
| bbot2 | Started: 15http://buildbot.pypy.org/builders/jit-benchmark-linux-x86-64-2/builds/49 | 23:00 |
| mattip | ahh, that was self.insn. hang on. | 23:00 |
| arigato | never mind | 23:00 |
| arigato | I see, it's exploding because it's trying to generate more than 256 different instructions | 23:00 |
| mattip | right. But why does win32 care more than linux, or is it just that no-one tried building linux yet? | 23:01 |
| arigato | I guess that linux is just below 256 for some reason | 23:02 |
| arigato | not sure why | 23:02 |
| arigato | but I guess that it would crash on linux the day we add a few more | 23:02 |
| arigato | see for example: | 23:04 |
| arigato | strsetitem/rcc | 23:04 |
| arigato | strsetitem/rci | 23:04 |
| arigato | strsetitem/rii | 23:04 |
| arigato | it's for strsetitem, which is "p.chars[i] = chr(n)", for various (p, i, n) | 23:04 |
| arigato | in this example we have three versions | 23:05 |
| arigato | the 'r' stands for the pointer to the string in all cases | 23:05 |
| arigato | the 'c' stands for "a small constant" | 23:05 |
| arigato | the 'i' stands for "a general integer" | 23:05 |
| Alex_Gaynor | amusingly no /ric | 23:06 |
| arigato | so if the RPython program also contained code like "p.chars[i] = '\x00'" | 23:06 |
| Alex_Gaynor | hehe | 23:06 |
| arigato | then it would also generate the /ric | 23:06 |
| arigato | indeed | 23:06 |
| arigato | that's why the total number of operations can very a bit | 23:06 |
| arigato | ...can vary a bit | 23:06 |
| arigato | unsure what to do now | 23:08 |
| arigato | we probably need to trim it down by cutting off the "/..c.." variants of the less-used operations | 23:08 |
| mattip | I don't really understand the ecosystem of the Assembler object, if there is only one (a singleton), | 23:09 |
| mattip | it would seem that as pypy grows it will explode at some point. | 23:09 |
| arigato | yes, that's what is occurring, but note that this list of operations comes from RPython | 23:10 |
| arigato | if we didn't have the 'c' optimization, there would be at most one variant for every "ll" operation, which are in finite number (<256) | 23:11 |
| mattip | ok. | 23:11 |
| mattip | unicode got around the problem by using 2 chars to encode, that would give more breathing space? | 23:12 |
| arigato | there is still a finite number of combinations of 'i' versus 'c', but that makes more than 256 in total | 23:12 |
| mattip | and break 10000000 other things. | 23:12 |
| arigato | yes, we do easily do that, but that's probably not the best solution | 23:12 |
| mattip | anyhow, I am out of my depth and out of time. :( | 23:13 |
| mattip | can I supply any more info before shutting down? | 23:14 |
| arigato | no, thank you | 23:14 |
| mattip | ttfn | 23:14 |
| mattip (~mattip@bzq-79-177-109-132.red.bezeqint.net) left irc: Quit: Leaving | 23:14 | |
| buribu (~buribu@177.18.238.209) joined #pypy. | 23:15 | |
| buribu (~buribu@177.18.238.209) left irc: Changing host | 23:15 | |
| buribu (~buribu@unaffiliated/buribu) joined #pypy. | 23:15 | |
| lucian (~lucian@cpc1-newc15-2-0-cust84.gate.cable.virginmedia.com) left irc: Ping timeout: 276 seconds | 23:33 | |
| kenaan | 12arigo default 11c5e504c2c62b 15/pypy/jit/codewriter/: Hopefully fix the Win32 translation, which has just hit the limit of generating more than 256 different instruction... | 23:33 |
| inhahe (~inhahe@adsl-074-186-083-219.sip.mia.bellsouth.net) left irc: Remote host closed the connection | 23:34 | |
| inhahe (~inhahe@adsl-074-186-083-219.sip.mia.bellsouth.net) joined #pypy. | 23:34 | |
| kenaan | 12arigo default 11b0d540cb3d25 15/pypy/jit/codewriter/assembler.py: Unification: the other unicode operations are not in the list either. | 23:34 |
| arigato (~arigo@xdsl-188-154-145-222.adslplus.ch) left irc: Quit: See you | 23:37 | |
| kenaan | 12arigo default 11b38d41e81500 15/pypy/jit/codewriter/assembler.py: these three operations are also rare | 23:38 |
| voidspace (~voidspace@python/psf/voidspace) left irc: Quit: Bye... | 23:47 | |
| lucian (~lucian@cpc1-newc15-2-0-cust84.gate.cable.virginmedia.com) joined #pypy. | 23:57 | |
| Trundle (~andy@python/site-packages/trundle) left irc: Remote host closed the connection | 23:59 | |
| --- Sun Jan 29 2012 | 00:00 | |
Generated by irclog2html.py 2.9.2 by Marius Gedminas - find it at mg.pov.lt!