[Bug]: Error occur when startup for json parse error.

[aib628]

Contact Details

No response

Is there an existing issue for this?

• I have searched all the existing issues

Priority

high

Current Behavior

When compass startup, JSONException happens and i see the error message attached below:

see source code at: task-metadata/src/main/java/com/oppo/cloud/meta/service/impl/ClusterConfigServiceImpl.java

Expected Behavior

as we know, http://{yarn ip}/conf will response content format as xml, but there parse with json, so error occur

Steps To Reproduce

No response

Compass Log

No response

Anything else? (Additional Context)

No response

[nilnon]

@aib628 This is a known problem. Different versions of hadoop will return different formats. We will adapt to this problem. If you are interested, you can submit a PR and adapt according to responseEntity.getHeaders().get(HttpHeaders.CONTENT_TYPE).

[zebozhuang]

@aib628 fixed.

[aib628]

@zebozhuang so gelivable!

[aib628]

@zebozhuang I found some duplicate code in : com.oppo.cloud.flink.service.impl.ClusterConfigServiceImpl#getYarnPathInfo
You can fixed it together.

[packyan]

@zebozhuang I found some duplicate code in : com.oppo.cloud.flink.service.impl.ClusterConfigServiceImpl#getYarnPathInfo

You can fixed it together.

PRs are welcomed. 😃

[aib628]

@packyan @zebozhuang I have adapt this fix to module task-flink, but clean code needed in the future.
Meanwhile, i have added support for variable attribute values to this feature, see detail at :