Any example to implement event stream mocking

Hi, Working on a project which requires HTTP mocking. Things works so far very well with the mockttp.

The only thing I am struggling with right now to implement the event stream. If we can have access to the response object that we can pass to our code which write events periodically that would solve the problem.

Any suggestions on how to do it the right way with mockttp?

[pimterry]

Currently the thenCallback supports different options to return, e.g. json, body. What if we can return stream from there? We can prepare the stream within thenCallback and return like return { stream: myStream }.

Yes, exactly. I think maybe you’ve misunderstood my example? That’s effectively the same as what I’m proposing in the example above.

The only difference is that in that case, we return the stream as another type of value for the existing body field, instead of a adding a new separate stream field. Does that make sense? It’s useful that way because it’s never meaningful to return both at the same time, and returning a stream there is unambiguous (because it’s currently not a valid value for that field).

It’s also better to start with just rawBody, not body, to make it clear that the stream data will not be automatically encoded (we can do that later, but it’s not needed immediately, and it’s not easy). We can do both later though, to support both pre-encoded & unencoded body streams.

Anyway, yust to make it clearer, I’m proposing that this would work:

server.forGet('/')
  .thenCallback((req) => {
    // Inside the callback, use 'req' to build a readable stream
    // for the body data:
    const yourStream = generateAStream(req);

    return {
        statusCode: 200,
        // If you return a stream as the body here, then the HTTP
        // response body will stream from this, and continue until
        // your stream ends:
        rawBody: yourStream
    };
  );

Is that clearer?

[pimterry]

Ah, I see, that makes sense. Yes, I think that’s not really supported right now. You could try creating many rules each matching different sets of parameters and returning different streams, but that won’t work for many cases (e.g. completely unknown freeform query params) and it’s quite awkward.

In future, I think this would probably be best supported by allowing it within thenCallback, with something like:

server.forGet('/')
  .thenCallback((req) => {
    return {
      statusCode: 200,
      body: buildCustomStream(req)
    };
  );

Doing this perfectly is a little harder than it sounds in some places - for example in the general case, the stream needs to be automatically encoded, whilst it’s streaming, using the appropriate compression algorithm (e.g. gzip). I think we can avoid that initially, but we’d need to do so explicitly…

How about we extend the result type from callbacks, so that the rawBody field can be returned with either a Buffer, or a Buffer stream? rawBody is never encoded - if you use it, you’re responsible for handling encoding yourself - but I think that’s probably fine for your case. We could then add stream support with automatic encoding in the body parameter later on, if necessary, with no breaking changes.

I’m open to something like this. I’m unlikely to have much time in the short-term to look into it myself, but PRs are very welcome.