<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
  <head>
    <meta content="text/html; charset=ISO-8859-1"
      http-equiv="Content-Type">
    <title></title>
  </head>
  <body bgcolor="#ffffff" text="#000000">
    Implementing the m/r functions in Erlang did the trick.<br>
    <br>
    - Jeremy<br>
    <br>
    On 5/10/2011 9:45 AM, Sean Cribbs wrote:
    <blockquote
      cite="mid:6F9BC420-A047-476E-BE29-187E3BD99B5D@basho.com"
      type="cite">You might see an error in the log, but there are a lot
      of things about the JS VM that are too opaque. It's on our list of
      things to improve, for sure.
      <div><br>
        <div>
          <span class="Apple-style-span" style="border-collapse:
            separate; color: rgb(0, 0, 0); font-family: Helvetica;
            font-size: medium; font-style: normal; font-variant: normal;
            font-weight: normal; letter-spacing: normal; line-height:
            normal; orphans: 2; text-indent: 0px; text-transform: none;
            white-space: normal; widows: 2; word-spacing: 0px;">
            <div>Sean Cribbs <<a moz-do-not-send="true"
                href="mailto:sean@basho.com">sean@basho.com</a>></div>
            <div>Developer Advocate</div>
            <div>Basho Technologies, Inc.</div>
            <div><a moz-do-not-send="true" href="http://basho.com/">http://basho.com/</a></div>
          </span>
        </div>
        <br>
        <div>
          <div>On May 10, 2011, at 9:30 AM, Jeremy Raymond wrote:</div>
          <br class="Apple-interchange-newline">
          <blockquote type="cite">Okay thanks. I figure something like
            this was going on. Besides the timeout return value is there
            any way to tell what happened or at what phase of some
            chained map reduce operations things failed? Would I see
            errors in the logs that indicated a crash of the Javascript
            engine or something along those lines?
            <div>
              <br clear="all">
              - Jeremy<br>
              <br>
              <br>
              <div class="gmail_quote">On Tue, May 10, 2011 at 9:27 AM,
                Sean Cribbs <span dir="ltr"><<a
                    moz-do-not-send="true" href="mailto:sean@basho.com">sean@basho.com</a>></span>
                wrote:<br>
                <blockquote class="gmail_quote" style="margin: 0pt 0pt
                  0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204);
                  padding-left: 1ex;">
                  <div style="word-wrap: break-word;">For large numbers
                    of objects, your JavaScript functions will become
                    bottlenecks, largely because the data has to be
                    converted to and from JSON for every application of
                    the function. If your reduce function isn't actually
                    coalescing a value (e.g. sort doesn't), then you
                    will run into this problem.  See if you can
                    reimplement the functions in Erlang or decrease the
                    quantity of values being passed to and returned from
                    the reduce functions.<br>
                    <div><br>
                    </div>
                    <div>
                      <span style="border-collapse: separate; color:
                        rgb(0, 0, 0); font-family: Helvetica; font-size:
                        medium; font-style: normal; font-variant:
                        normal; font-weight: normal; letter-spacing:
                        normal; line-height: normal; text-indent: 0px;
                        text-transform: none; white-space: normal;
                        word-spacing: 0px;">
                        <div>
                          Sean Cribbs <<a moz-do-not-send="true"
                            href="mailto:sean@basho.com" target="_blank">sean@basho.com</a>></div>
                        <div>Developer Advocate</div>
                        <div>Basho Technologies, Inc.</div>
                        <div><a moz-do-not-send="true"
                            href="http://basho.com/" target="_blank">http://basho.com/</a></div>
                      </span>
                    </div>
                    <br>
                    <div>
                      <div>On May 10, 2011, at 9:20 AM, Jeremy Raymond
                        wrote:</div>
                      <br>
                      <blockquote type="cite"><span
                          style="border-collapse: separate; font-family:
                          Helvetica; font-style: normal; font-variant:
                          normal; font-weight: normal; letter-spacing:
                          normal; line-height: normal; text-indent: 0px;
                          text-transform: none; white-space: normal;
                          word-spacing: 0px; font-size: medium;">
                          <div link="blue" vlink="purple" lang="EN-US">
                            <div>
                              <div style="margin: 0in 0in 0.0001pt;
                                font-size: 11pt; font-family:
                                Calibri,sans-serif;">Hello,</div>
                              <div style="margin: 0in 0in 0.0001pt;
                                font-size: 11pt; font-family:
                                Calibri,sans-serif;">
                                 </div>
                              <div style="margin: 0in 0in 0.0001pt;
                                font-size: 11pt; font-family:
                                Calibri,sans-serif;">In a MapReduce job
                                I have filtering through about 6500
                                items if I filter out enough items my
                                m/r job completes successfully. If I
                                loosen the filtering such that a large
                                number of items would be included in the
                                results the m/r fails with error
                                {error,javascript_reduce_timeout}. This
                                error occurs after about 10 seconds of
                                processing. Would Javascript errors such
                                as the Javascript process running out of
                                memory and crashing result in this
                                timeout error? I also noticed that after
                                this error is returned, the riak node I
                                made the request on chugs along at ~100%
                                CPU for about another minute but the
                                other two nodes quite down almost
                                immediately after the error is returned.
                                How might I go about debugging this?</div>
                              <div style="margin: 0in 0in 0.0001pt;
                                font-size: 11pt; font-family:
                                Calibri,sans-serif;"> </div>
                              <div style="margin: 0in 0in 0.0001pt;
                                font-size: 11pt; font-family:
                                Calibri,sans-serif;">
                                - Jeremy</div>
                              <div style="margin: 0in 0in 0.0001pt;
                                font-size: 11pt; font-family:
                                Calibri,sans-serif;"> </div>
                            </div>
---------------------------------------------------------------------<span> </span><br>
                            This transmission (including any
                            attachments) may contain confidential
                            information, privileged material (including
                            material protected by the solicitor-client
                            or other applicable privileges), or
                            constitute non-public information. Any use
                            of this information by anyone other than the
                            intended recipient is prohibited. If you
                            have received this transmission in error,
                            please immediately reply to the sender and
                            delete this information from your system.
                            Use, dissemination, distribution, or
                            reproduction of this transmission by
                            unintended recipients is not authorized and
                            may be
                            unlawful._______________________________________________<br>
                            riak-users mailing list<br>
                            <a moz-do-not-send="true"
                              href="mailto:riak-users@lists.basho.com"
                              style="color: blue; text-decoration:
                              underline;" target="_blank">riak-users@lists.basho.com</a><br>
                            <a moz-do-not-send="true"
href="http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com"
                              style="color: blue; text-decoration:
                              underline;" target="_blank">http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com</a><br>
                          </div>
                        </span></blockquote>
                    </div>
                    <br>
                  </div>
                  <br>
                  _______________________________________________<br>
                  riak-users mailing list<br>
                  <a moz-do-not-send="true"
                    href="mailto:riak-users@lists.basho.com">riak-users@lists.basho.com</a><br>
                  <a moz-do-not-send="true"
href="http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com"
                    target="_blank">http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com</a><br>
                  <br>
                </blockquote>
              </div>
              <br>
            </div>
          </blockquote>
        </div>
        <br>
      </div>
    </blockquote>
  </body>
</html>