rails 6 - error when parsing non-array response body

[samanthawritescode]

rails 6 - error when parsing non-array response body

[samanthawritescode]

Alright, fresh eyes after the weekend did me good, I think I figured out the issue.

The problem is actually on this line in Middlewares::ResponseValidation.call:

body = body.to_ary if body.respond_to?(:to_ary)

The problem is that body.respond_to?(:to_ary) returns true, but it shouldn't, because the response is not an array (it's a JSON object). So when we call body.to_ary, body ends up nil.

So why are we incorrectly calling to_ary and why does it end up nil?

I'm using Rails 6.1.7.7, and the respond_to? and to_ary methods are defined as such in ActionDispatch:

      def respond_to?(method, include_private = false)
        if method.to_sym == :to_path
          @response.stream.respond_to?(method)
        else
          super
        end
      end

      def to_ary
        nil
      end

This has since changed in rails 7, and I assume that's what the intended behavior was.

As for what the actual fix is, I'm not sure, this is a quite a bit more in the weeds of Rails/Rack than I typically get. I hope that's helpful, though.

[ahx]

Hi. I was able to reproduce this and will probably release a fix this weekend.

[samanthawritescode]

@MrBananaLord I ran the same request without the response validation middleware after installing the gem, upgrading any dependencies, etc... just commenting out the config.middleware.use OpenapiFirst::Middlewares::ResponseValidation line. It succeeds successfully.

I'll see if I can get a reproducible example.

[ahx]

This should be fixed and now just work in 1.3.6, which has just been released. Thanks for the report.

[samanthawritescode]

Actually, body is still nil in this case, I think that's why now it says it can't parse. I'm honestly kind of at a loss here, any help would be appreciated. My OAS is here, but I changed the URL parameters to continue testing according to this issue.

[ahx]

Thanks for the report @samanthawritescode. I am not fully understanding what's going on here. Can you reproduce this in a test, Maybe a rack-test test or Rails' request test and can share a part of that maybe?

[MrBananaLord]

I am wondering... what happens when you run the same request without the validation middleware? could it be that you are getting a 302? 🤔

[ahx]

@samanthawritescode Thanks for the update. This is helpful. I still have a hard time understanding the Rack spec about these parts. That's probably why this slipped through.
If I understand you correctly this happens only in tests, right? This looks similar to something I tested/implemented here. Maybe we can come up with a (failing) test that looks similar.

[ahx]

What I don't get about the spec is what middlewares should check first: call, to_ary or each. I will have to find some time to look into that. I hope that this issue does not block you. If it does, let's look for a quick solution instead.

[ahx]

I did not find the time to reproduce this. Can you maybe share a tiny example app via a gist or the like?

[samanthawritescode]

Great, thanks! Sorry, I had to pivot to work on something else, so I haven't had further time to poke at this.